-- Logs begin at Thu 2022-09-22 11:49:30 UTC, end at Thu 2022-09-22 12:46:25 UTC. -- Sep 22 12:14:39.172528 dv-cinder-856463-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 22 12:14:39.181482 dv-cinder-856463-4-smb devstack@keystone.service[81367]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 12:14:39 2022] *** Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: nodename: dv-cinder-856463-4-smb Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: machine: x86_64 Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: clock source: unix Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: pcre jit disabled Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: detected number of CPU cores: 4 Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: current working directory: / Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: detected binary path: /usr/bin/uwsgi-core Sep 22 12:14:39.183477 dv-cinder-856463-4-smb devstack@keystone.service[81367]: your processes number limit is 47680 Sep 22 12:14:39.184096 dv-cinder-856463-4-smb devstack@keystone.service[81367]: your memory page size is 4096 bytes Sep 22 12:14:39.184096 dv-cinder-856463-4-smb devstack@keystone.service[81367]: detected max file descriptor number: 2048 Sep 22 12:14:39.184096 dv-cinder-856463-4-smb devstack@keystone.service[81367]: lock engine: pthread robust mutexes Sep 22 12:14:39.184096 dv-cinder-856463-4-smb devstack@keystone.service[81367]: thunder lock: enabled Sep 22 12:14:39.184096 dv-cinder-856463-4-smb devstack@keystone.service[81367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 22 12:14:39.184096 dv-cinder-856463-4-smb devstack@keystone.service[81367]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 12:14:39.224608 dv-cinder-856463-4-smb devstack@keystone.service[81367]: Python main interpreter initialized at 0x55ad506339c0 Sep 22 12:14:39.224608 dv-cinder-856463-4-smb devstack@keystone.service[81367]: python threads support enabled Sep 22 12:14:39.224608 dv-cinder-856463-4-smb devstack@keystone.service[81367]: your server socket listen backlog is limited to 100 connections Sep 22 12:14:39.224608 dv-cinder-856463-4-smb devstack@keystone.service[81367]: your mercy for graceful operations on workers is 90 seconds Sep 22 12:14:39.224945 dv-cinder-856463-4-smb devstack@keystone.service[81367]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 12:14:39.225030 dv-cinder-856463-4-smb devstack@keystone.service[81367]: *** Operational MODE: preforking *** Sep 22 12:14:39.225304 dv-cinder-856463-4-smb devstack@keystone.service[81367]: *** uWSGI is running in multiple interpreter mode *** Sep 22 12:14:39.225304 dv-cinder-856463-4-smb devstack@keystone.service[81367]: spawned uWSGI master process (pid: 81367) Sep 22 12:14:39.225500 dv-cinder-856463-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 22 12:14:39.226455 dv-cinder-856463-4-smb devstack@keystone.service[81367]: spawned uWSGI worker 1 (pid: 81379, cores: 1) Sep 22 12:14:39.226455 dv-cinder-856463-4-smb devstack@keystone.service[81367]: spawned uWSGI worker 2 (pid: 81380, cores: 1) Sep 22 12:14:39.227032 dv-cinder-856463-4-smb devstack@keystone.service[81367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 12:14:43.509826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:14:43.509826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: from cryptography.utils import int_from_bytes Sep 22 12:14:43.510587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:14:43.510587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: from cryptography.utils import int_from_bytes Sep 22 12:14:43.510587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:14:43.510587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: from cryptography.utils import int_from_bytes Sep 22 12:14:43.511105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:14:43.511105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: from cryptography.utils import int_from_bytes Sep 22 12:14:43.559663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 12:14:43.559825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 12:14:43.560425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 12:14:43.560556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 12:14:43.560644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] command line args: [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 12:14:43.560754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] command line args: [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 12:14:43.560841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 12:14:43.560993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ================================================================================ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 12:14:43.561071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 12:14:43.561198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ================================================================================ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 12:14:43.561276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] admin_token = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.561455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] admin_token = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.561546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_dir = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.561652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.561731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config_dir = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.561838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_source = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.561962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] debug = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config_source = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] debug = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.562940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563043 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_config_append = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.563878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_config_append = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_dir = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_dir = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.564969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.565937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.566950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.567078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.567163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.567327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.567405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.567606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.567898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] publish_errors = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] publish_errors = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.568992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] standard_threads = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] standard_threads = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.569914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_journal = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_json = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_journal = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_stderr = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_json = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_syslog = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_stderr = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.570975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_syslog = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.571118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:14:43.571194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.571369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.571451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.571609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.571692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.571854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.572922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.573889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.574851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.575007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.575084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.575245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.575322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.575501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.575626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.576338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.576505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.576582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.576651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.576818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.576897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.577907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.578833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.579981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.580991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.581923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.582995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.583918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.584967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.585914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.586984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.587922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.588923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.589941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.590889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.591880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592553 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.592881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.593973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.594954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.595883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.596883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.external = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.external = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.597810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.password = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.token = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.password = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.token = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.598946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.599900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.600944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.601921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.602870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.603891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.604887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.605998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.606991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.607973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.608996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.609948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.610899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.611887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.612846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.613949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.614996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.615993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.616909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.617944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.618903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.619759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.620868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.621970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.622048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.622202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.622288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.622950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.623907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.624975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.625916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.626881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.627830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.628950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.629993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.630953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.631884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.632879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.633858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.634984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.635984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.636942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.637917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.638121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.638697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.638863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.638943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.639917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.640868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.641985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.642942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.643881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.644970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.645949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.646890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.647833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.648950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 12:14:43.649653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:14:43.649810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 12:14:43.678635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.678864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.678967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.679088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.679174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.679409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.688047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.688424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.716637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.716751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.716849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.716986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.770983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.771311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.820302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.820538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.820720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.820962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.976703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.976885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.976959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:43.977878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.002958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.003737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.014763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.015114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.027498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.027678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.027765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.027906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.028922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.029058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 12:14:44.046046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.046254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 12:14:44.046601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.046728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.046811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 12:14:44.046943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 12:14:44.047063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.047326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.047476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.047587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.047799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 12:14:44.047888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.048320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.048796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.049273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.049737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.057689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.057970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.058242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.058527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.065451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.065737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.066014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.066302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.066424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.069338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.069630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.069918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.070203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.070489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.070753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.071027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.071304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.071576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.071850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.072146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.073292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.076288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.076580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.076869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.077163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.077456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.077723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.077998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.078276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.078552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.078831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.079104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.097528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.099008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.099301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.103249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.104164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.104290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.104578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.104757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.105047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.111496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.111783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.111963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.112196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.112486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.117529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.117830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.118121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.118408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.118684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.118817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.118947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.119101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.119240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.119489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.125244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.125546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.125841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.126138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.126422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.126704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.126981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.127256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.135047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.135332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.139162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.142356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.142660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.142789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.142999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.146798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.146930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.149934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.150070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.150296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.153164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.153467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.154269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.154557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.154837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.154970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.155133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.158134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.161376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.161681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.161971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.162260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.162546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.162841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.171465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.171755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.172052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.172317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.179103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.179251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.179383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.179656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.179946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.180667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.182185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.182476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.185698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.185984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.186282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.186569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.186969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.187279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.188854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.190401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.190684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.193423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.193726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.194021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.194311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.194706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.199047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.199047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.199047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.199047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.199284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.199526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.199811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.206401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.206691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.206976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.207266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.207653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.207978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.208277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.215597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.218540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.221515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.223016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.223582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.224509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.224799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.225197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.226512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.229444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.230884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.231514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.232404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.232693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.233030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.233128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.235895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.236318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.236611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.236894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.239403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.240886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.243770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.244192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.244486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.244660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.244770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.245220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.245503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.252851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.253140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.253313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.253426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.253609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.253717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.253896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.253979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.254258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.254536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.254821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.255109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.255393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.255666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.255943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.256221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.256502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.260730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 12:14:44.261020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.261305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.261587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.261872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.262150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.262427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.262725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.263557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.263856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.264246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.264530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.264830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.265144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 12:14:44.290802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad506339c0 pid: 81379 (default app) Sep 22 12:14:44.294049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b85e-7692-419c-be4f-ee13b653d06a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:44.294366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b85e-7692-419c-be4f-ee13b653d06a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:44.294640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b85e-7692-419c-be4f-ee13b653d06a None None] PATH_INFO: `/v3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:44.299285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad506339c0 pid: 81380 (default app) Sep 22 12:14:44.299393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu Sep 22 12:14:44 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:14:51.038688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:51.039292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:51.039292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:51.040582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:14:51.048788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:51.049368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:51.049368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:51.118640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: INFO dbcounter [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] Registered counter for database keystone Sep 22 12:14:51.137434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG oslo_db.sqlalchemy.engines [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:14:51.143518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writer thread running {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:14:51.321156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG passlib.handlers.bcrypt [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81380) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 12:14:51.321468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG passlib.handlers.bcrypt [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81380) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 12:14:51.379586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:14:51.381200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:14:51.506759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:14:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 12:14:51.971295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:52.040480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: INFO dbcounter [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] Registered counter for database keystone Sep 22 12:14:52.062414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG oslo_db.sqlalchemy.engines [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:14:52.068537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writer thread running {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:14:52.186208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a877b0-b1b9-4711-9876-7c8c3b5c7d0f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:52.190490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:52.191108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:52.191395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:52.191666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:52.200112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:52.251653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 12:14:52.251963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5cc44-e259-4bd6-94b0-3e55d4d77b51 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:52.261276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Sep 22 12:14:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:14:52.267157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:52.281774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098ef1-7661-4d84-a64b-f7ff1eeba38b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:52.286221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:52.287371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:52.287655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:52.287946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] PATH_INFO: `/v3/projects/d1d2459aef21456aad8510f367ebb7a7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:52.289404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1d2459aef21456aad8510f367ebb7a7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:52.342165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 12:14:52.342512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb246eb9-e2e2-48e8-ba54-5633baa474b5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:52.346999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Sep 22 12:14:52 2022] GET /identity/v3/projects/d1d2459aef21456aad8510f367ebb7a7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:14:54.509199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a426-6d6e-40c2-a7f9-c607df578436 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:54.509717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a426-6d6e-40c2-a7f9-c607df578436 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:54.510054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515a426-6d6e-40c2-a7f9-c607df578436 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:54.518522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:14:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:14:54.524872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:54.525371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:54.525862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:54.547781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:14:54.549631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:14:54.557478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:14:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 12:14:54.825155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a426-6d6e-40c2-a7f9-c607df578436 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:54.837644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515a426-6d6e-40c2-a7f9-c607df578436 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:54.841986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f820ec-032f-4a42-9071-b4f76784a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:54.842590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f820ec-032f-4a42-9071-b4f76784a711 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:54.842870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f820ec-032f-4a42-9071-b4f76784a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:54.843145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f820ec-032f-4a42-9071-b4f76784a711 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:54.850991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f820ec-032f-4a42-9071-b4f76784a711 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:54.852826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f820ec-032f-4a42-9071-b4f76784a711 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:54.861439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Sep 22 12:14:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:14:54.867060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:54.876920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05483971-c8dc-4b28-ba97-2d4b26eb0bff None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:54.881432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb360c-0ab1-4b4d-9eb5-3c059cc591b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:54.882066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb360c-0ab1-4b4d-9eb5-3c059cc591b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:54.882354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb360c-0ab1-4b4d-9eb5-3c059cc591b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:54.882712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb360c-0ab1-4b4d-9eb5-3c059cc591b3 admin admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:54.883956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb360c-0ab1-4b4d-9eb5-3c059cc591b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:54.885802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb360c-0ab1-4b4d-9eb5-3c059cc591b3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:54.888005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu Sep 22 12:14:54 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:14:57.094719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a894618-7d2e-4096-a156-064e455dba29 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.095285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a894618-7d2e-4096-a156-064e455dba29 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.095381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a894618-7d2e-4096-a156-064e455dba29 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.096741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:14:57.101969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.102372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.102514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.109400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8dc19-b0bf-4925-9ad4-47a0addb8b03 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.109682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8dc19-b0bf-4925-9ad4-47a0addb8b03 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.109954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8dc19-b0bf-4925-9ad4-47a0addb8b03 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.111211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 7/11] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:14:57.116267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.116548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.116827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.121316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:14:57.122500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:14:57.158013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG passlib.handlers.bcrypt [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81379) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 12:14:57.158408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG passlib.handlers.bcrypt [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81379) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 12:14:57.200601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:14:57.207740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:14:57.209366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:14:57.306170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:14:57.464821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:57.488388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:57.568945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820264-9424-460f-a1f2-f300d9fbde09 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:57.572984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:57.602875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:57.603544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.603829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.604136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.614911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:14:57.624464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:14:57.625393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:14:57.626237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:14:57.628071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 6/14] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:14:57.631276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:57.671266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b501983-9a0e-459e-a935-658f5d089f9e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:57.673539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:57.709134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:57.709997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.710277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.710547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.710826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:57.729560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762a69-2bea-4066-976b-c46794f14b33 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:57.762617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:57.763224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.763501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.763770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.764468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:14:57.764771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:57.766150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:57.777346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 7/15] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:14:57.778406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:57.779960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:57.782938 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:57.877351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 12:14:57.879026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cdacf-1104-4ed8-bee1-14126e3c6b47 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:57.882614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:57.885238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:57.913064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:57.913691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:57.913968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:57.914245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:57.915368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:57.916847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:57.918408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 8/17] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:14:57 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:14:57.923831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:57.937926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:57.983496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb1dd2-3ea8-4d08-9d06-076f34401000 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:58.016947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:58.017796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:58.018075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:58.018352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:58.021455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268382b-0cbb-41bb-a2c1-90e7beb4b84c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:58.036821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:58.038278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:58.055495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:58.056147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:58.056423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:14:58.056566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:14:58.057507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:14:58.058305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:14:58.058305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:14:58.058305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:14:58.058467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:58.058530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:14:58.059174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:58.059877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:58.061443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:14:58.063954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:58.066798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:14:58.119386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:58.144835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:14:58.163636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee48bbe-7f30-4d45-92b9-2d2b24a36f8e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:58.164081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882e5c-92a3-4712-9cd9-6e88a11d2d7b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:14:58.199986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:58.200315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:14:58.200603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:58.200878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:58.200978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:14:58.201146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:58.201230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:14:58.201464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:14:58.201874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.domain.id=default, user.id=fd86245075d845f9b1e45490eee3a3a1) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:14:58.202119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:14:58.202209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:58.202427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:14:58.203632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642ef73-c23e-4020-93c4-11b51efce3a2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:58.203806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0728c-db89-41c7-a4f5-ceed8ca8f4fa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:14:58.210511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Sep 22 12:14:58 2022] GET /identity/v3/role_assignments?user.id=fd86245075d845f9b1e45490eee3a3a1&scope.domain.id=default&role.id=972430f30d6d40b1b22793c8952f489e => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:14:58.222454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:00.888153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00a554-daab-49fc-afc4-cae9802fc60b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:00.888658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00a554-daab-49fc-afc4-cae9802fc60b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:00.888732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00a554-daab-49fc-afc4-cae9802fc60b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:00.890024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:00.895280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23061d4-dc9d-4d12-8245-2d5ef26aa466 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:00.895800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23061d4-dc9d-4d12-8245-2d5ef26aa466 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:00.895884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23061d4-dc9d-4d12-8245-2d5ef26aa466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:00.923781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c23061d4-dc9d-4d12-8245-2d5ef26aa466 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:00.925023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c23061d4-dc9d-4d12-8245-2d5ef26aa466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:00.966482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5624dd7-0aca-4091-ae17-dd13286d8237 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:00.966826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5624dd7-0aca-4091-ae17-dd13286d8237 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:00.967046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5624dd7-0aca-4091-ae17-dd13286d8237 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:00.968438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:00.974598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eacc53-cf33-4b09-bb04-a2ba9e1d8621 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:00.974888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eacc53-cf33-4b09-bb04-a2ba9e1d8621 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:00.975172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eacc53-cf33-4b09-bb04-a2ba9e1d8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.015570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-29eacc53-cf33-4b09-bb04-a2ba9e1d8621 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:01.016824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-29eacc53-cf33-4b09-bb04-a2ba9e1d8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:01.072281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:01.073875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9cc8a-4692-4a0a-a5dc-5d10e044f9ed None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.074707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9cc8a-4692-4a0a-a5dc-5d10e044f9ed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.074986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9cc8a-4692-4a0a-a5dc-5d10e044f9ed None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.076600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 13/25] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:01.077938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff07d-bab2-4294-870b-f61ea8e7d965 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.078227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff07d-bab2-4294-870b-f61ea8e7d965 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.078501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ff07d-bab2-4294-870b-f61ea8e7d965 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.079817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:01.085269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.085555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.085836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.104739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:01.106082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:01.145973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:01.147191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.147482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.147762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.180264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:01.202136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:01.203356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:01.248018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:01.320023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:01.439313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:01.575863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746ed56-a938-4d11-9ff8-944acb849bbc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:01.615649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:01.616329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.616611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.616887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.636813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:01.643352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:01.644245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:01.645425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 16/30] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:01.650400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:01.657708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:01.721159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:01.783902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:01.804241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895514a-8664-4214-af27-0e82580c8f0f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:01.854673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:01.855566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.855864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.856172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.857078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:01.857267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:01.858639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:01.867571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 15/31] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:01.868372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:01.873101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbbda8-9925-463a-a863-eb88d3fb52fb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:01.912512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:01.914460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:01.914956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:01.915415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:01.916445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:01.919023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:01.958942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:01.997893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e1fc1-baa2-462f-897a-d1803e5c81ec None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.033545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.034180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.034462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.034741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.046052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.047537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:15:02.067420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:02.068533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:15:02.069318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:15:02.069318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:15:02.069318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:02.070952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 16/32] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:02.072073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:02.095956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 17/33] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 22 12:15:01 2022] POST /identity/v3/roles => generated 219 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:15:02.095956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:02.259056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:02.266626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560284d9-7a48-46c7-9fde-63c623ff2cdb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.283043 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc59f1b-6318-43d6-afc0-30649da14b56 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.307662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:02.317864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.318536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.318825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.319106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.320890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.322525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.328187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:02 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:02.329207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:02.347509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.348191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.348473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.348743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.349440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.350874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.470884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dfb75-52cc-40cf-beb4-657efa71c87f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.489087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 17/35] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 22 12:15:02 2022] POST /identity/v3/roles => generated 225 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:02.492022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:02.520719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.521268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.521545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.521815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.522479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:02.522783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.524325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248e181-9f2a-487c-ae82-c70349f32ecd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.538790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 19/36] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:02.540379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbfdd-afe3-4117-94da-fa793fdff860 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.540686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbfdd-afe3-4117-94da-fa793fdff860 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.540939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbfdd-afe3-4117-94da-fa793fdff860 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.542236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 20/37] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:02.547254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbfdd-afe3-4117-94da-fa793fdff860 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:02.582873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:02.631264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad83dd5-34d0-4e52-93b9-f7f320a9824c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.669828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbfdd-afe3-4117-94da-fa793fdff860 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.671223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1547c0-d6d2-4546-a092-0bd480b99d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.672213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1547c0-d6d2-4546-a092-0bd480b99d80 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.672714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1547c0-d6d2-4546-a092-0bd480b99d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.672994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1547c0-d6d2-4546-a092-0bd480b99d80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.674355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1547c0-d6d2-4546-a092-0bd480b99d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.675979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1547c0-d6d2-4546-a092-0bd480b99d80 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.682345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 18/38] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:02.682345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4163d-49d2-4a67-8535-bfb8e8294891 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.682345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4163d-49d2-4a67-8535-bfb8e8294891 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.682345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4163d-49d2-4a67-8535-bfb8e8294891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.699046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-26c4163d-49d2-4a67-8535-bfb8e8294891 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:02.700607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-26c4163d-49d2-4a67-8535-bfb8e8294891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:02.715835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f7a64-764c-421f-965d-a38bc5880030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.716808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f7a64-764c-421f-965d-a38bc5880030 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.716808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f7a64-764c-421f-965d-a38bc5880030 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.717041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f7a64-764c-421f-965d-a38bc5880030 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.717770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f7a64-764c-421f-965d-a38bc5880030 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.719156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f7a64-764c-421f-965d-a38bc5880030 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.751280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:02.757581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:15:02 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:02.759128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c6c5-e1cf-467a-8bcf-2bba70dbb2e2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.759573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c6c5-e1cf-467a-8bcf-2bba70dbb2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.759850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c6c5-e1cf-467a-8bcf-2bba70dbb2e2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.761123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 22/40] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:02.761845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c6c5-e1cf-467a-8bcf-2bba70dbb2e2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:02.781128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 19/41] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:02.782501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.782802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.783065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.809959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:02.811164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:02.874658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:02.895523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:02.909036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c6c5-e1cf-467a-8bcf-2bba70dbb2e2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:02.952966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:02.954391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:02.954928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:02.955405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] PATH_INFO: `/v3/domains/default/users/fd86245075d845f9b1e45490eee3a3a1/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:02.957664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fd86245075d845f9b1e45490eee3a3a1, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:02.959474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:02.980996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1361 bytes} [Thu Sep 22 12:15:02 2022] PUT /identity/v3/domains/default/users/fd86245075d845f9b1e45490eee3a3a1/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:03.075223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:03.173978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:03.291551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5b72-993b-4606-abad-303c155e53a8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:03.295196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be1fee-bcba-45a6-bbea-197c924ee4d8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:03.302793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:03.332442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d93928-caeb-46fc-a17c-70453dd1c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:03.332967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93928-caeb-46fc-a17c-70453dd1c551 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:03.333249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93928-caeb-46fc-a17c-70453dd1c551 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:03.333522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93928-caeb-46fc-a17c-70453dd1c551 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:03.334190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93928-caeb-46fc-a17c-70453dd1c551 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:03.335575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93928-caeb-46fc-a17c-70453dd1c551 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:03.335714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:03.336512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:03.336799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:03.337077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:03.338209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:03.339753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:03.341641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 24/44] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:03.347137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:03.351773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:03.353532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 21/45] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 22 12:15:03 2022] POST /identity/v3/roles => generated 223 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:03.463283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2224c-58d6-420d-92c5-a3e6fba59a67 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:03.501464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cab49-4b17-4b5d-bf8a-6c8a8b28da76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:03.502100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cab49-4b17-4b5d-bf8a-6c8a8b28da76 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:03.502390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cab49-4b17-4b5d-bf8a-6c8a8b28da76 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:03.502665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cab49-4b17-4b5d-bf8a-6c8a8b28da76 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:03.503335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cab49-4b17-4b5d-bf8a-6c8a8b28da76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:03.505174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cab49-4b17-4b5d-bf8a-6c8a8b28da76 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:03.536512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:15:03 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:15:05.160326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459746c-a61b-48fe-a053-5e908046efc4 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.160840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459746c-a61b-48fe-a053-5e908046efc4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.160952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459746c-a61b-48fe-a053-5e908046efc4 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.162217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:05.168252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.168664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.168803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.186474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:05.187985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:05.237478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:05.254395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:05.517644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459746c-a61b-48fe-a053-5e908046efc4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:05.621240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459746c-a61b-48fe-a053-5e908046efc4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:05.654858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54b2dc-b1a7-46d2-b77f-b8871285d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:05.655489 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b2dc-b1a7-46d2-b77f-b8871285d81e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.655774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b2dc-b1a7-46d2-b77f-b8871285d81e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.656090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b2dc-b1a7-46d2-b77f-b8871285d81e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.666493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54b2dc-b1a7-46d2-b77f-b8871285d81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5a54b2dc-b1a7-46d2-b77f-b8871285d81e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:05.671413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:05.672291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:05.673036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 23/49] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:05.678347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:05.698394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34dc9e-9034-4adf-9b75-2ff517926c88 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.699611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34dc9e-9034-4adf-9b75-2ff517926c88 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.699896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34dc9e-9034-4adf-9b75-2ff517926c88 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.701264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 24/50] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:05.706330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.706615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.706900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.725124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:05.726316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:05.747117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:05.776802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e90fee-32cb-44c9-a65c-2a2107a3a569 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:05.795273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 25/51] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:05.809508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:05.810122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.810408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.810685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.811356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:05.811662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:05.813080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:05.825849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 27/52] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:05.831740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:05.928638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d09ecf-548e-4c68-9bbe-2d96472b1e91 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:05.962236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:05.962867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:05.963168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:05.963433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:05.964611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:05.966064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:05.967635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:05 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:05.973097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:06.061625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:06.088260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:06.124588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:06.163949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547497f-2ce0-4a66-a793-04bcea6316b4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:06.174465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75a2d-3eef-464c-91fe-adb5e2158fb2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:06.203691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:06.204326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:06.204612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:06.204889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:06.205997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:06.207466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:06.208200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:06.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:06.209085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 27/54] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:06.209202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:06.209456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:06.210635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:06.212101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:06.213866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:06.214471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:06.219206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:06.308749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:06.316770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5233ad-dc19-4922-8eaa-46049978141f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:06.317708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb8263-3806-4109-96b1-31900560bad7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:06.332476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:06.349967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:06.350610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:06.350870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58deb954-a73e-4980-a67d-ecd387a75785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:06.350972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:06.351154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:06.351529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deb954-a73e-4980-a67d-ecd387a75785 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:06.351817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deb954-a73e-4980-a67d-ecd387a75785 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:06.351905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.domain.id=default, user.id=fd86245075d845f9b1e45490eee3a3a1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:06.352122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58deb954-a73e-4980-a67d-ecd387a75785 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:06.352217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:06.352765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58deb954-a73e-4980-a67d-ecd387a75785 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:06.353634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833229-81d1-4f35-a5ec-7e19d4d09e34 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:06.354220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58deb954-a73e-4980-a67d-ecd387a75785 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:06.362357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 29/56] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Sep 22 12:15:06 2022] GET /identity/v3/role_assignments?user.id=fd86245075d845f9b1e45490eee3a3a1&scope.domain.id=default&role.id=972430f30d6d40b1b22793c8952f489e => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:06.385091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 28/57] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Sep 22 12:15:06 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:15:08.532575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead930-c0f1-496c-a41a-04a1c3463149 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:08.533084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead930-c0f1-496c-a41a-04a1c3463149 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:08.533084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead930-c0f1-496c-a41a-04a1c3463149 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:08.534386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:08.539592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:08.540044 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:08.540182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:08.557898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:08.559076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:08.628628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:08.898521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ead930-c0f1-496c-a41a-04a1c3463149 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:09.002631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ead930-c0f1-496c-a41a-04a1c3463149 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:09.035766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963d40c-30b7-492c-aa8c-1a0fc1ad2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:09.036422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963d40c-30b7-492c-aa8c-1a0fc1ad2206 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:09.036703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963d40c-30b7-492c-aa8c-1a0fc1ad2206 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:09.036973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963d40c-30b7-492c-aa8c-1a0fc1ad2206 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:09.038076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963d40c-30b7-492c-aa8c-1a0fc1ad2206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:09.039807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963d40c-30b7-492c-aa8c-1a0fc1ad2206 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:09.041406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:09.046885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:09.119055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:09.145327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546a884-2268-438e-9481-ecc5ac33be69 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:09.177119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc050d2e-8bcc-43f0-8859-65be490d3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:09.177666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050d2e-8bcc-43f0-8859-65be490d3405 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:09.177950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050d2e-8bcc-43f0-8859-65be490d3405 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:09.178227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050d2e-8bcc-43f0-8859-65be490d3405 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:09.178884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc050d2e-8bcc-43f0-8859-65be490d3405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:09.180362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc050d2e-8bcc-43f0-8859-65be490d3405 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:09.207223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:09 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:12.462164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fba479-4067-409d-aae6-48aaa24b01ed None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.463146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fba479-4067-409d-aae6-48aaa24b01ed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.463629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fba479-4067-409d-aae6-48aaa24b01ed None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.465872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:12.471337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23423-e7ef-4380-a169-96e1f3feef6d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.472219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23423-e7ef-4380-a169-96e1f3feef6d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.472697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23423-e7ef-4380-a169-96e1f3feef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.500911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-40f23423-e7ef-4380-a169-96e1f3feef6d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:12.502491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-40f23423-e7ef-4380-a169-96e1f3feef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:12.595336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:12.638801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7268a-ebdf-438a-9969-764f9f66b541 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.639406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7268a-ebdf-438a-9969-764f9f66b541 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.639880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7268a-ebdf-438a-9969-764f9f66b541 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.641484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 33/64] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:12.646975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.647485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.647984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.671594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ec9a9-3f65-4540-abc5-6bd6d3a5c204 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.672256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ec9a9-3f65-4540-abc5-6bd6d3a5c204 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.672758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ec9a9-3f65-4540-abc5-6bd6d3a5c204 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.674306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 34/65] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:12.680988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305f07-8873-4eff-8c71-8b49f9412b37 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.681522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305f07-8873-4eff-8c71-8b49f9412b37 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.681999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305f07-8873-4eff-8c71-8b49f9412b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.692231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:12.693447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:12.713392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-79305f07-8873-4eff-8c71-8b49f9412b37 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:12.714537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-79305f07-8873-4eff-8c71-8b49f9412b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:12.775811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:12.787449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:12.800174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:12.838219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 35/67] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:12.952084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:12.961718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd0d14-0369-41b9-952b-c891bfa1c64a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.962421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd0d14-0369-41b9-952b-c891bfa1c64a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.964564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd0d14-0369-41b9-952b-c891bfa1c64a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:12.966107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 36/68] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:12.971749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:12.972232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:12.972642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.002702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:13.003887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:13.125242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 37/69] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:13.131291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bc82-853b-438e-8f86-6a44232003ec None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.131395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.191302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.192021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.192305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.192584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.211591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:13.216934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:13.217964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:13.218927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:13.221182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 33/70] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:13.222113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.273397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb3389-b0b0-4b5d-a773-e7eab187004e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.282811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.284825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.315282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.316191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.316608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.317012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.327600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:13.332755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:13.333732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:13.334651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:13.336423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 38/71] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:13.337376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.348329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9606-eaad-4047-bb3d-9019f339b6c8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.387624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.388388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.388677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.388956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.400513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:13.406863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:13.407835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:13.408652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:13.409216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 34/72] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:13.411228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.444750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be398dd-3696-42ea-a4fd-d3fd033df814 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.478934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.481145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.481451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.481731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.482413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:13.482723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:13.484150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b4f3f-a583-439d-93b9-cd23a9ad1186 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:13.492465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 39/73] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:13.493875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf483e-402f-4884-88e7-7fe3cf7daff8 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.494151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf483e-402f-4884-88e7-7fe3cf7daff8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.494430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf483e-402f-4884-88e7-7fe3cf7daff8 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.495638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 40/74] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:13.498035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf483e-402f-4884-88e7-7fe3cf7daff8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.517968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfc23b-07d5-4a34-a0b0-8006164082b4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.525282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.529218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.553289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.553901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.554184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.554461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.555129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:13.555435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:13.556871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:13.564762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 35/75] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:13.565549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.596892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf483e-402f-4884-88e7-7fe3cf7daff8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.630829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.631461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.631741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.632040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.632703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:13.633016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:13.634366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:13.642382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 41/76] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:13.643160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.670353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a2797-9afe-4b19-bf7c-af3476cb39d2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.705358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49958f-cac9-4c0c-89d5-e4f24980424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.706014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49958f-cac9-4c0c-89d5-e4f24980424b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.706301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49958f-cac9-4c0c-89d5-e4f24980424b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.706578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49958f-cac9-4c0c-89d5-e4f24980424b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.716997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49958f-cac9-4c0c-89d5-e4f24980424b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-3f49958f-cac9-4c0c-89d5-e4f24980424b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:13.722251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:13.723078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:13.723823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 36/77] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:13.724513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.724759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.725071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.737365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.742123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:13.743331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:13.746489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90923b2-60bc-4023-b8e3-8f1f604e1036 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.768959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.780762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.781395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.781677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.781955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.796406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:13.797850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:13.799469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 42/78] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:13.800278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.809590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 37/79] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:13.810626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.914538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd62e02-349c-4928-b6f9-3f25f3b042d3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.918331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135efc0-6310-4fd7-b1bb-0a774da59f94 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:13.951613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.952281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.952569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.952848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.953989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:13.954582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:13.955216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:13.955456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:13.955559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:13.955800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:13.957276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:13.957775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 38/80] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:13.958702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:13.965406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 43/81] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:13.965406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.965621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:13.982523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:13.994687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.069910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e75a-9798-4703-a6e4-b1cb7dd497df None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.071256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3ef3e-2930-4c28-9463-1987a4a04f1b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.104903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.105506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.105786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.106056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.106708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:14.107009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.107099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.107662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.107972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.108254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.108437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.116250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 39/82] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:14.117032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.175752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.177233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.196867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.209118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.217861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcb16a-5406-43ff-8baf-fe5ed88ed7a5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.250487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.251027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.251308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.251581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.279556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 44/83] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:14.280781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.321508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.322986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.375768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce24058-fb49-4c89-92e1-388ea138dbac None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.392957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.410052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.410667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.410949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.411049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.411226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.421150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 40/84] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:14.421960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.477395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.478884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.516100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cb3cc-d2ad-4c89-956a-c1c51b7eeeb2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.548548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.549172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.549449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.549722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.550815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.552271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.553811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 41/85] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:14.554645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.577398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:14.578250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.595880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.612829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.653079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ac55-5e35-417d-937b-c6c714577934 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.675592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f73f6-f929-496c-84ce-b16a922d5401 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.687050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.687684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.687990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.688274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.689454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.691041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.692656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 42/87] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:14.693424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.709935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.710567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.710841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.711110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.712247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.713713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.715320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 46/88] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:14.716073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.793616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb9ae-ebbe-4720-ae6d-727a74af3aef None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.799393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.817684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911725ff-b8f1-4539-89b3-a94cac80b660 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.819359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:14.827588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.828289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.828576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.828853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.829988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.831447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.833125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 43/89] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:14.833886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.851902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.852540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.852818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.853091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.853738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.855766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.882828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 47/90] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:14 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:14.883635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:14.947413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d050e0a-626a-4779-ab02-713619daa157 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:14.988739 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:14.989582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:14.989921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:14.990192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:14.992403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:14.995389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:14.997240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 44/91] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:14.998571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:15.005096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cb5fa-7905-4fcf-bdc6-68ff1d16dbea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:15.045300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:15.046270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:15.046749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:15.047357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:15.060805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:15.072729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:15.120760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c92e03-f73e-483c-83aa-6e49da9dbb7e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:15.127638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:15.129409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:15.159698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:15.160784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:15.160784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:15.161066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:15.162993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=605f457b5dee4da089b04c3cf70f8345) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:15.162993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:15.163545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:15.172035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 45/92] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/role_assignments?user.id=605f457b5dee4da089b04c3cf70f8345&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:15.172873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:15.270668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 48/93] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:15.271913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:15.316742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e48ecf-9417-4484-a6bd-5365e19944d1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:15.326383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:15.355981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:15.367799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:15.369288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:15.369288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:15.369288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:15.372322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] RBAC: Adding query filter params (role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=605f457b5dee4da089b04c3cf70f8345) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:15.372651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:15.374164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:15.380675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 46/94] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:15 2022] GET /identity/v3/role_assignments?user.id=605f457b5dee4da089b04c3cf70f8345&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:15.381852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:15.429753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43a0c-1db2-48da-8cba-9b3445794385 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:15.472210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:15.473002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:15.473658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:15.474073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:15.475183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=fd86245075d845f9b1e45490eee3a3a1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:15.475599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:15.477204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:15.484288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 49/95] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:15 2022] GET /identity/v3/role_assignments?user.id=fd86245075d845f9b1e45490eee3a3a1&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:15.584735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256deb17-f68a-4892-85f7-ea074a168e6f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:15.632363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a7de-de8b-4bbb-aadf-fe82a74e6be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:15.633032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a7de-de8b-4bbb-aadf-fe82a74e6be9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:15.633322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a7de-de8b-4bbb-aadf-fe82a74e6be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:15.633603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a7de-de8b-4bbb-aadf-fe82a74e6be9 None admin] PATH_INFO: `/v3/projects/22ad87441e1c474381d7287649562c3e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:15.640881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a7de-de8b-4bbb-aadf-fe82a74e6be9 None admin] RBAC: Authorizing `identity:get_project(project_id=22ad87441e1c474381d7287649562c3e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:15.642437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a7de-de8b-4bbb-aadf-fe82a74e6be9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:15.644293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 47/96] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:15 2022] GET /identity/v3/projects/22ad87441e1c474381d7287649562c3e => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:15.650690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:15.811522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16502-6a41-4650-abab-52f41183e4d7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:15.819214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:15.852849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:15.853395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:15.853677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:15.853951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:15.854734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=22ad87441e1c474381d7287649562c3e, user.id=605f457b5dee4da089b04c3cf70f8345) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:15.855051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:15.856554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097349fc-3b90-4c3b-b3c9-5fcac8dd33f5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:15.865925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 50/97] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:15 2022] GET /identity/v3/role_assignments?user.id=605f457b5dee4da089b04c3cf70f8345&scope.project.id=22ad87441e1c474381d7287649562c3e&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:17.799345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e243-0ebf-420f-a158-304e599a95c7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:17.799855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e243-0ebf-420f-a158-304e599a95c7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:17.799996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e243-0ebf-420f-a158-304e599a95c7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:17.801611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 48/98] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:17.806562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e43332-d9f1-4df7-9cc1-bec685ed8f2d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:17.806950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e43332-d9f1-4df7-9cc1-bec685ed8f2d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:17.807189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e43332-d9f1-4df7-9cc1-bec685ed8f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:17.833003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c1e43332-d9f1-4df7-9cc1-bec685ed8f2d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:17.834262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c1e43332-d9f1-4df7-9cc1-bec685ed8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:17.918414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 51/99] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:18.456590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e243-0ebf-420f-a158-304e599a95c7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:18.487888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259f244-cf28-4002-ae7d-2086df4d397c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.488214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259f244-cf28-4002-ae7d-2086df4d397c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.488489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259f244-cf28-4002-ae7d-2086df4d397c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.489990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 52/100] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:18.495738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137382-8fd9-4f0f-a90a-c04423c61e70 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.496050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137382-8fd9-4f0f-a90a-c04423c61e70 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.496330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137382-8fd9-4f0f-a90a-c04423c61e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.526449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:18.529586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9b137382-8fd9-4f0f-a90a-c04423c61e70 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:18.531021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b137382-8fd9-4f0f-a90a-c04423c61e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:18.573247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e243-0ebf-420f-a158-304e599a95c7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:18.610069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:18.611212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.611642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.612228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.620489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 53/101] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:18.622328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22997-f3d9-4c5d-ad30-57729a373e6b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.622821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22997-f3d9-4c5d-ad30-57729a373e6b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.623296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e22997-f3d9-4c5d-ad30-57729a373e6b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.624684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:18.625002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 54/102] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:18.626334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b8ae-77e8-43a6-925e-a36331e7e9ad None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.626813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b8ae-77e8-43a6-925e-a36331e7e9ad None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.627284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b8ae-77e8-43a6-925e-a36331e7e9ad None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.628698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 55/103] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:18.630411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:18.631238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:18.632217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 49/104] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:18.634779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932a5c-5fb7-40b7-9c2b-7d2a01a43416 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.635272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932a5c-5fb7-40b7-9c2b-7d2a01a43416 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.635705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932a5c-5fb7-40b7-9c2b-7d2a01a43416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.638200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:18.670790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-50932a5c-5fb7-40b7-9c2b-7d2a01a43416 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:18.672447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-50932a5c-5fb7-40b7-9c2b-7d2a01a43416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:18.720382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:18.797092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ae66-a5d7-4960-8c1c-c91f874ef841 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:18.805422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 56/105] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:18.806854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04319a-e336-499d-a361-b992a40d6fd2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.808164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04319a-e336-499d-a361-b992a40d6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.808847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04319a-e336-499d-a361-b992a40d6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.829310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ee04319a-e336-499d-a361-b992a40d6fd2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:18.830809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ee04319a-e336-499d-a361-b992a40d6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:18.836590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:18.867607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:18.868267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.868808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.869082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.869938 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:18.870285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:18.871696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:18.890093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 50/106] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:18.896082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:18.906667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 57/107] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:18.969012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae9cf-9437-4b71-a8a4-acbbe9f911d2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:18.969304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae9cf-9437-4b71-a8a4-acbbe9f911d2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:18.969585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae9cf-9437-4b71-a8a4-acbbe9f911d2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:18.971609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 58/108] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:18.973484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae9cf-9437-4b71-a8a4-acbbe9f911d2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.038699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035991-e80b-4972-9f62-48237a90264f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.075186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61076a53-0b84-4195-9111-68def93c300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.075868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076a53-0b84-4195-9111-68def93c300d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.076130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076a53-0b84-4195-9111-68def93c300d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.076411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076a53-0b84-4195-9111-68def93c300d None admin] PATH_INFO: `/v3/users/1c32029fac7343ea99d3fcd9e54c9823` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.078256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.090165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae9cf-9437-4b71-a8a4-acbbe9f911d2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.094091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61076a53-0b84-4195-9111-68def93c300d None admin] RBAC: Authorizing `identity:get_user(user_id=1c32029fac7343ea99d3fcd9e54c9823)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:19.095567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61076a53-0b84-4195-9111-68def93c300d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:19.097261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 51/109] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:18 2022] GET /identity/v3/users/1c32029fac7343ea99d3fcd9e54c9823 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:19.098481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.098773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.099050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.117753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:19.119173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:19.129467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.130438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.130921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.131428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.132844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:19.134641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:19.137154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 59/110] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:19.138166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.156653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.199152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 52/111] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:19.199152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.264822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350a568-e459-47ca-be63-56f8fb6a8027 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.301215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.302188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.302670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.303140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.331467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.366547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200ba9e-007e-4cf6-aceb-cffa80ad79e1 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.385793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:19.387833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:19.405360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df467-cbf0-4e84-97d0-1ef6bd3e8129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.405981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df467-cbf0-4e84-97d0-1ef6bd3e8129 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.406266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df467-cbf0-4e84-97d0-1ef6bd3e8129 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.406544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df467-cbf0-4e84-97d0-1ef6bd3e8129 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.407196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df467-cbf0-4e84-97d0-1ef6bd3e8129 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:19.408705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df467-cbf0-4e84-97d0-1ef6bd3e8129 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:19.443968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 53/112] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:15:19 2022] POST /identity/v3/projects => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:19.443968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868b28-2c53-45f3-b059-a22f0400766b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.443968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868b28-2c53-45f3-b059-a22f0400766b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.443968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef868b28-2c53-45f3-b059-a22f0400766b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.443968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 54/113] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:19.445579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef868b28-2c53-45f3-b059-a22f0400766b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.491662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.537358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 60/114] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:19.538509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.596440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef868b28-2c53-45f3-b059-a22f0400766b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.612293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.638410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710c5aa-c00e-4d85-8477-c042f2e8d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.639047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c5aa-c00e-4d85-8477-c042f2e8d0df None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.639330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c5aa-c00e-4d85-8477-c042f2e8d0df None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.639608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c5aa-c00e-4d85-8477-c042f2e8d0df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.652139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710c5aa-c00e-4d85-8477-c042f2e8d0df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f710c5aa-c00e-4d85-8477-c042f2e8d0df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:19.657451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:19.658327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:19.659073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 55/115] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:19.659839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.660829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.660829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.664186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d32e15-0606-492a-8da1-ea54dfd6cc7f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.679183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:19.680452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:19.703910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.704910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.705253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.705803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.717174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:19.722114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:19.722976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 61/116] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:19.724435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.752546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 56/117] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:19.761626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.780897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.831305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4e880-91eb-4221-b3db-0c7d6766c3f5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.851562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:19.871481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.872241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.872591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.873228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.874067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:19.875666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:19.877381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 62/118] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:19.878214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.907497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9e32c-e576-4336-951f-70c22610689a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:19.944536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:19.945326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:19.945712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:19.946124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:19.959355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:19.965040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:19.965988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:19.966820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:19.972523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 57/119] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:19.973199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:19.997054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05893d-79e5-4730-8032-ecb79022039e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.033826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.034533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.034878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.035157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.035827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:20.036155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.037534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.046316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 63/120] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.049086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.060158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.092308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f91254-8dd5-4967-ac78-435ae55d1099 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.100306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.127354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.127992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.128276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.128550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.129213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:20.129579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.130970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.144620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 58/121] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.144620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.162422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1827-3c99-4e75-886f-a927fc646db8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.205352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.205979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.206260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.206513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.207243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] RBAC: Adding query filter params (role.id=ee7c10e8a9914cd3a0a971b8c385f26c, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=1c32029fac7343ea99d3fcd9e54c9823) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:20.207548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.209028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.215978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 64/122] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/role_assignments?user.id=1c32029fac7343ea99d3fcd9e54c9823&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=ee7c10e8a9914cd3a0a971b8c385f26c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.215978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.263089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5254c2-e7a4-477e-adab-6622396b1a47 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.301940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.302917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.303336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.303749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.304620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:20.305206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.306891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.309213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.318631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 59/123] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.324828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.360527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630aa30f-83a2-4644-8ab5-272120e6a4ae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.376992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.401608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.402409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.402689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.403014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.416186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:20.421256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:20.422125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:20.422902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:20.428573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 65/124] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:20.428573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.459684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749a273-d33b-43e5-88ab-5fa0f0c6e128 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.497926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.498659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.499048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.499392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.500628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.502257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.504083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 60/125] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.506063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.561565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ed22-5c4d-4770-abe6-1e9d695ca77f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.582105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.613728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.614995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.615867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.616667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.618925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.621771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.624245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 66/126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.625205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.625491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d853-4371-4ab5-82e5-001f56a7ebb0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.662098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.662881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.663247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.663633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.665022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.667323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.669228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 61/127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.674061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.690059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.763584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05875f-eb8e-40fa-8802-4dba7be815f6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.799887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5692a-95ea-480c-8e06-4ebe1a382770 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.815706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.816918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.817395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.818197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.819058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:20.819554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.821821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.830569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.835976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 67/128] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.836428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.836700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.837352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.837982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.839587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.840126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.842707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:20.845648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 62/129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:20.846442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:20.956411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4774-7b21-40be-b012-fd7c7c11588e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.980045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758bed0-4b39-4186-bd44-a75d44181f20 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:20.982853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:20.994144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:20.994869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:20.995157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:20.995435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:20.996667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:20.999084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.001699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 63/130] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:21.002916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:21.032309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.033893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.034396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.035092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.037116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.039060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.042677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 68/131] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:20 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:21.043738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:21.074980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:21.115811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9bdc-4aa6-4430-a535-961f10acf6cb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:21.153591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.154869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.155050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.155293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.156604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.158496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.160749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 64/132] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:21 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:21.161732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:21.189321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f145c-5479-46e7-9d43-305a75f058ae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:21.248235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.249233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.249706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.250188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/fd86245075d845f9b1e45490eee3a3a1/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.252409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=048cb71d8f1347878fd9a5a035ab7562, user_id=fd86245075d845f9b1e45490eee3a3a1, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.254570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.273901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:21 2022] PUT /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/fd86245075d845f9b1e45490eee3a3a1/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:21.276304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:21.281966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbdd30-0a74-4741-ac45-56095e885607 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:21.320126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:21.326637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.327659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.327963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.328268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/605f457b5dee4da089b04c3cf70f8345/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.330567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=048cb71d8f1347878fd9a5a035ab7562, user_id=605f457b5dee4da089b04c3cf70f8345, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.332160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.337868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:21.363202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:21 2022] PUT /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/605f457b5dee4da089b04c3cf70f8345/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:21.364170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:21.428064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8c8f1-695d-4882-bfa6-a92478025e34 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:21.473132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.474215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.474692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.475181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/605f457b5dee4da089b04c3cf70f8345/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.478618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] RBAC: Authorizing `identity:create_grant(project_id=048cb71d8f1347878fd9a5a035ab7562, user_id=605f457b5dee4da089b04c3cf70f8345, role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.480519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.498325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 70/135] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:21 2022] PUT /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/605f457b5dee4da089b04c3cf70f8345/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:21.587216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d91438-667c-4183-8098-c38e19f4cff1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:21.632221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ed84a-17ea-4e94-ad1f-7eb2859fd1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.633292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ed84a-17ea-4e94-ad1f-7eb2859fd1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.633766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ed84a-17ea-4e94-ad1f-7eb2859fd1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.634231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ed84a-17ea-4e94-ad1f-7eb2859fd1f1 None admin] PATH_INFO: `/v3/projects/22ad87441e1c474381d7287649562c3e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.636401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ed84a-17ea-4e94-ad1f-7eb2859fd1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=22ad87441e1c474381d7287649562c3e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.638198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ed84a-17ea-4e94-ad1f-7eb2859fd1f1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.644247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:21 2022] GET /identity/v3/projects/22ad87441e1c474381d7287649562c3e => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:21.650473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:21.758497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:21.772477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac970016-c14e-487f-980d-c091dd4fe904 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:21.808010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca408-100f-415a-87e4-2b725a93c53a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.808393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca408-100f-415a-87e4-2b725a93c53a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.808771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ca408-100f-415a-87e4-2b725a93c53a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.810535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 67/137] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:21.811240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:21.811972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.812429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.812713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] PATH_INFO: `/v3/projects/22ad87441e1c474381d7287649562c3e/users/605f457b5dee4da089b04c3cf70f8345/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.818560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] RBAC: Authorizing `identity:create_grant(project_id=22ad87441e1c474381d7287649562c3e, user_id=605f457b5dee4da089b04c3cf70f8345, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:21.819106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:21.819389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:21.819669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:21.820062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:21.849045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:21 2022] PUT /identity/v3/projects/22ad87441e1c474381d7287649562c3e/users/605f457b5dee4da089b04c3cf70f8345/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:21.861508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:21.863090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:21.944317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:21.956482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:22.297790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:22.421814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d7a80-0318-4e98-964c-7506d5ddbcde None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:22.469606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0611e-584d-4c1a-bcc4-9ac15dd22b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:22.470170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0611e-584d-4c1a-bcc4-9ac15dd22b6f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:22.470465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0611e-584d-4c1a-bcc4-9ac15dd22b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:22.470722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0611e-584d-4c1a-bcc4-9ac15dd22b6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:22.472645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0611e-584d-4c1a-bcc4-9ac15dd22b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:22.474093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0611e-584d-4c1a-bcc4-9ac15dd22b6f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:22.475661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 72/140] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:22.481762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:22.620649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b831e-c329-4964-bc2d-1fffd27ad644 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:22.668718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc510-dd00-4cd5-a6c1-31a0d7c0b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:22.669351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc510-dd00-4cd5-a6c1-31a0d7c0b88a None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:22.669628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc510-dd00-4cd5-a6c1-31a0d7c0b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:22.669901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc510-dd00-4cd5-a6c1-31a0d7c0b88a None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:22.670557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc510-dd00-4cd5-a6c1-31a0d7c0b88a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:22.672032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc510-dd00-4cd5-a6c1-31a0d7c0b88a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:22.702662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 69/141] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:22 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:23.188260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ad8e-0236-495a-b2f1-bb573bbdd7ec None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:23.188766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ad8e-0236-495a-b2f1-bb573bbdd7ec None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:23.188839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ad8e-0236-495a-b2f1-bb573bbdd7ec None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:23.190155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 73/142] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:23.196360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:23.196802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:23.196981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:23.221903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:23.223154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:23.283811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:23.310520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 70/143] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:23.851515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ad8e-0236-495a-b2f1-bb573bbdd7ec None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:23.877444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:23.976477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ad8e-0236-495a-b2f1-bb573bbdd7ec None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:24.012147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:24.012790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.013068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.013343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.024791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:24.030368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:24.031190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:24.031983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 74/144] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:24.037867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:24.177758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1641373-00ba-4e61-9999-de36182502b2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:24.237070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:24.238522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.239002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.239472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.240451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:24.240959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:24.242595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:24.253230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 71/145] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:24.258398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:24.370488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:24.395113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656977b-25f4-4d2a-b6ad-174a8b84b58c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:24.435996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a6d-fabf-44c6-8447-c1cd568e4d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:24.436569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a6d-fabf-44c6-8447-c1cd568e4d3d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.436850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a6d-fabf-44c6-8447-c1cd568e4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.437121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a6d-fabf-44c6-8447-c1cd568e4d3d None admin] PATH_INFO: `/v3/users/1c32029fac7343ea99d3fcd9e54c9823` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.438276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d0a6d-fabf-44c6-8447-c1cd568e4d3d None admin] RBAC: Authorizing `identity:get_user(user_id=1c32029fac7343ea99d3fcd9e54c9823)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:24.439853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d0a6d-fabf-44c6-8447-c1cd568e4d3d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:24.441479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 75/146] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:24 2022] GET /identity/v3/users/1c32029fac7343ea99d3fcd9e54c9823 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:24.448013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:24.510555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f846-1183-44f6-b76a-d1ced3609b82 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.510860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f846-1183-44f6-b76a-d1ced3609b82 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.511108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f846-1183-44f6-b76a-d1ced3609b82 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.517282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 76/147] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:24.519435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:24.522871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.523149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.523453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.552785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:24.554615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:24.620863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08938b5-2d99-4197-9f2c-02fd1ed8b629 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:24.651718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 77/148] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:24.674028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066f872-b0fe-4e8e-abba-15954788d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:24.674702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066f872-b0fe-4e8e-abba-15954788d896 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.674984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066f872-b0fe-4e8e-abba-15954788d896 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.675255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066f872-b0fe-4e8e-abba-15954788d896 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.676555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066f872-b0fe-4e8e-abba-15954788d896 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:24.678036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066f872-b0fe-4e8e-abba-15954788d896 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:24.679884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 72/149] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:24 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:24.686341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:24.779065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:24.808545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea05b9-931c-4b90-a523-357980350ec8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:24.846071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50ec21-d146-4f56-bdd0-20b83b565350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:24.847035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50ec21-d146-4f56-bdd0-20b83b565350 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.847543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50ec21-d146-4f56-bdd0-20b83b565350 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.848049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50ec21-d146-4f56-bdd0-20b83b565350 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/1c32029fac7343ea99d3fcd9e54c9823/roles/ee7c10e8a9914cd3a0a971b8c385f26c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.850231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50ec21-d146-4f56-bdd0-20b83b565350 None admin] RBAC: Authorizing `identity:create_grant(project_id=048cb71d8f1347878fd9a5a035ab7562, user_id=1c32029fac7343ea99d3fcd9e54c9823, role_id=ee7c10e8a9914cd3a0a971b8c385f26c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:24.852020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50ec21-d146-4f56-bdd0-20b83b565350 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:24.877395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 78/150] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:24 2022] PUT /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562/users/1c32029fac7343ea99d3fcd9e54c9823/roles/ee7c10e8a9914cd3a0a971b8c385f26c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:24.957691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00941680-fd0d-412a-ad25-eb5a718216f1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.958240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00941680-fd0d-412a-ad25-eb5a718216f1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.958704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00941680-fd0d-412a-ad25-eb5a718216f1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:24.960303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 73/151] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:24.982581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:24.983133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:24.983574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.008620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:25.010170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:25.021673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96ef0-fa2d-44ef-8cca-bb694efd16b8 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.022227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96ef0-fa2d-44ef-8cca-bb694efd16b8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.022673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96ef0-fa2d-44ef-8cca-bb694efd16b8 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.024257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 74/152] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:25.029827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.030344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.030789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.067136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:25.070061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:25.205128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 79/153] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:25.205816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:25.241661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 75/154] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:25.302222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:25.350378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d86b0-06e0-4a40-9f4d-b38024ca822c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:25.387613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:25.388303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.388578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.388850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.402843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:25.407895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:25.408875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:25.409619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 80/155] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:25.415117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:25.473560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:25.543667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5332654-8b0b-4d6e-8d2a-e5fd92102b5b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:25.591953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:25.592593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.592874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.593147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.593824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:25.594302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:25.595707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1dd30-6818-4464-93e1-89b8ec72c690 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:25.605048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 76/156] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:25.612575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:25.641850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1ae2-3b85-4180-9641-05b4f6d14f48 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.642170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1ae2-3b85-4180-9641-05b4f6d14f48 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.642407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1ae2-3b85-4180-9641-05b4f6d14f48 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.643882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 77/157] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:25.649249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.649610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.649797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.681949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:25.683386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:25.761277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac49fc-c25f-44a9-9f8e-391c643b7522 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:25.797953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 78/158] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:25.801513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:25.816644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:25.817426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:25.817987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:25.818258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] PATH_INFO: `/v3/users/fd86245075d845f9b1e45490eee3a3a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:25.819428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] RBAC: Authorizing `identity:get_user(user_id=fd86245075d845f9b1e45490eee3a3a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:25.820902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:25.823325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 81/159] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:25 2022] GET /identity/v3/users/fd86245075d845f9b1e45490eee3a3a1 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:25.828611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:25.857064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:25.872530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:25.967366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818a658-f45e-41ed-84b9-2b93bc3cd2b7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:26.019789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:26.020450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:26.020729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:26.021002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:26.065247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18d216-9560-4545-84d5-8087048790d3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:26.117090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:26.118823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:26.136870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:26.137616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:26.137889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:26.138158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:26.174747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:26.175743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:26.185027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:26.186011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:26.186841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:26.188878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 82/160] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:26.192662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:26.344538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:26.346943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 79/161] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:26.350650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:26.455843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c443d-50bc-4073-ad57-bfc47e6ea5cd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:26.530503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:26.531533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:26.532048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:26.532535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:26.542805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd849e-57aa-495a-8d0e-4adbccc83ff0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:26.550141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:26.561996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:26.562877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:26.563698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:26.565973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 83/162] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:26.566957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:26.590867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:26.618053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:26.618985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:26.619888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:26.620277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:26.620890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:26.621188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:26.622709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:26.639966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 80/163] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:26.648004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:26.783027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287cb7-64f5-431e-b471-ec61c291a436 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:26.812065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:26.880746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:26.881436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:26.881780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:26.882120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:26.888635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:26.890179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:26.892096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 84/164] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:26 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:26.892808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:26.963208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bdcf-7b2c-40b0-a198-4717346adfdf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.076415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.077613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.078160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.078636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.082989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417da90-0092-45bd-ad9c-92f4333b87cd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.112916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:27.118905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:27.120367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:27.121138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:27.123624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 81/165] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 483 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:27.128827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:27.140989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.141539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.141817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.142088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.142756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:27.143055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:27.146104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:27.163303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 85/166] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:27.164175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:27.280279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:27.282939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:27.398839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e04cf-ce06-47a6-aa76-6d1db5f12770 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.413653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65079fb1-031c-4489-a740-9e67ee05e97b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.448416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.449071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.449352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.449615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.450334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=fd86245075d845f9b1e45490eee3a3a1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:27.450633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:27.452088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:27.458314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 86/167] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:27 2022] GET /identity/v3/role_assignments?user.id=fd86245075d845f9b1e45490eee3a3a1&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:27.459098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:27.485361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.486021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.486304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.486583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.492633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:27.494414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:27.496060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 82/168] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:27 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:27.496924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:27.574373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fd0c3-d4b7-4f0b-8e93-d6d8fe01db7e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.590491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:27.628323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.628957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.629233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.629500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.630175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:27.630471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:27.631865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:27.646871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 87/169] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:27.647756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:27.722066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46b3d7-4219-4bfa-9ba5-e960f198cdf2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.804162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725fa5c-e81e-4ec6-b1b8-f1e1c7538d3b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:27.815657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:27.828397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.829060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.829347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.829625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.830876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:27.833729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:27.840065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 83/170] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:27 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:27.841010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:27.845473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:27.846093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:27.846373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:27.846639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:27.892330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:27.923172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:27.924842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.020243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4864e-1488-407b-94f7-37569241ebc7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.052746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 88/171] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:28.053621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:28.075781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.076508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.076801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.077089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] PATH_INFO: `/v3/users/605f457b5dee4da089b04c3cf70f8345` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.078362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] RBAC: Authorizing `identity:get_user(user_id=605f457b5dee4da089b04c3cf70f8345)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.079824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.081584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 84/172] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:27 2022] GET /identity/v3/users/605f457b5dee4da089b04c3cf70f8345 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:28.083271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:28.157563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.160811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.206438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0903d-b6a7-48db-a6e1-b78ec13e71be None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.241314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.241958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.242242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.242521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.243912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.246101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.248134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 85/173] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:28 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:28.249019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:28.249902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f84ef5-759a-49a1-ba30-9e3b9b56280c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.361834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b62030-dcf7-4632-906a-dfd47b51ed0b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.392389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.401361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c8d7f-4666-44e5-a255-e1125abc8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.402000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8d7f-4666-44e5-a255-e1125abc8110 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.402279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8d7f-4666-44e5-a255-e1125abc8110 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.402840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c8d7f-4666-44e5-a255-e1125abc8110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.404152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4026c-3e74-46b0-903b-39dfd6434cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.405322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4026c-3e74-46b0-903b-39dfd6434cbc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.407736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4026c-3e74-46b0-903b-39dfd6434cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.408104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4026c-3e74-46b0-903b-39dfd6434cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.494188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4026c-3e74-46b0-903b-39dfd6434cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.495870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4026c-3e74-46b0-903b-39dfd6434cbc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.508455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c8d7f-4666-44e5-a255-e1125abc8110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.510255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c8d7f-4666-44e5-a255-e1125abc8110 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.578154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.594169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 86/174] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:28.595416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bdf3-79dc-44ab-9f09-5562df98e57c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.595710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bdf3-79dc-44ab-9f09-5562df98e57c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.596003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bdf3-79dc-44ab-9f09-5562df98e57c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.597464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 87/175] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:28.600720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bdf3-79dc-44ab-9f09-5562df98e57c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:28.612574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 89/176] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:28.613801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9610fc-d8b9-43c3-853d-db08af7e16f1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.614084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9610fc-d8b9-43c3-853d-db08af7e16f1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.614351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9610fc-d8b9-43c3-853d-db08af7e16f1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.615590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 90/177] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:28.617694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d81ff-f4e4-4d55-8158-5c93813d2f59 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.617694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d81ff-f4e4-4d55-8158-5c93813d2f59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.617694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d81ff-f4e4-4d55-8158-5c93813d2f59 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.618800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 91/178] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:28.620017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a58f8-b407-4a30-bfbf-1a805c0e38da None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.620200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a58f8-b407-4a30-bfbf-1a805c0e38da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.620412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a58f8-b407-4a30-bfbf-1a805c0e38da None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.623980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 92/179] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:28.623980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a58f8-b407-4a30-bfbf-1a805c0e38da None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:28.637231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.710134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bdf3-79dc-44ab-9f09-5562df98e57c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.721969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a58f8-b407-4a30-bfbf-1a805c0e38da None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.742668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.743528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.743801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.744126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.744850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=605f457b5dee4da089b04c3cf70f8345) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:28.745153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.746586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4173c-8809-4d82-95b8-6e6362946add None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.752478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 88/180] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:28 2022] GET /identity/v3/role_assignments?user.id=605f457b5dee4da089b04c3cf70f8345&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:28.754613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.755237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.755509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.755775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] PATH_INFO: `/v3/projects/22ad87441e1c474381d7287649562c3e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.756927 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] RBAC: Authorizing `identity:get_project(project_id=22ad87441e1c474381d7287649562c3e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.758387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.760965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 93/181] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:28 2022] GET /identity/v3/projects/22ad87441e1c474381d7287649562c3e => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:28.761781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:28.762178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577177cf-839a-4e5c-9815-1faf1ae12aba None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.762611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577177cf-839a-4e5c-9815-1faf1ae12aba None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.763031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577177cf-839a-4e5c-9815-1faf1ae12aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.784945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-577177cf-839a-4e5c-9815-1faf1ae12aba None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:28.786190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-577177cf-839a-4e5c-9815-1faf1ae12aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:28.811142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.861528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 89/182] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:28.865546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446659a5-de23-4250-b1a2-fbdc46f4abe3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.865789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446659a5-de23-4250-b1a2-fbdc46f4abe3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.866040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446659a5-de23-4250-b1a2-fbdc46f4abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.887921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd33d92-25ee-473a-b381-3009d4751dfa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:28.890505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-446659a5-de23-4250-b1a2-fbdc46f4abe3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:28.892763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-446659a5-de23-4250-b1a2-fbdc46f4abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:28.918388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:28.941679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04549234-2c56-4f0a-9060-fd2e09718c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:28.941679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04549234-2c56-4f0a-9060-fd2e09718c2d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.941679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04549234-2c56-4f0a-9060-fd2e09718c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.942012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04549234-2c56-4f0a-9060-fd2e09718c2d None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.943586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04549234-2c56-4f0a-9060-fd2e09718c2d None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:28.945943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04549234-2c56-4f0a-9060-fd2e09718c2d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:28.948165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 94/183] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:28 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:28.949390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.949675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.949943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:28.969879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:28.971079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:28.984391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 90/184] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:28.985832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:28.986165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:28.986555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.015117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:29.016338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:29.050403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 95/185] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:29.051400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.095684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.095864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 91/186] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:29.101016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.185954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb1b3-0539-4247-b040-e21d26d8fc49 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.236727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.248484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95206108-723d-4329-9e51-4d0e3e1a0ed6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.260859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.261476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.261749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.262016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.262751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=22ad87441e1c474381d7287649562c3e, user.id=605f457b5dee4da089b04c3cf70f8345) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:29.263071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:29.264527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:29.284672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 96/187] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/role_assignments?user.id=605f457b5dee4da089b04c3cf70f8345&scope.project.id=22ad87441e1c474381d7287649562c3e&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:29.285151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.285479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.285866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.286150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.286424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.287162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] RBAC: Adding query filter params (role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=605f457b5dee4da089b04c3cf70f8345) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:29.287475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:29.288992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:29.300093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 92/188] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/role_assignments?user.id=605f457b5dee4da089b04c3cf70f8345&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:29.328594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.511524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.515481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7099c-1a47-485e-b627-7844246a0cd2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.519714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36c58-7215-49e6-b385-19c3e1954dbb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.563014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.566556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.566556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.566556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.576236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.576711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:29.576880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.577166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.577440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:29.582493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:29.583445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:29.584426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:29.589904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 97/189] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:29.590820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.592569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:29.598890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:29.599797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:29.600617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 93/190] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:29.601715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.606989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.698123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f063a2-defc-42c7-9582-b63df0f37949 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.706793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f16ac-dc87-4b64-a952-c2ffa30cbc42 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.730581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.731202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.731472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.731735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.732867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:29.734291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:29.735846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 98/191] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:29.739779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.740435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.740710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.740878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.740998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.751504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:29.756307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:29.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 94/192] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:29.758313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.771910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.820828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.843022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd680e3-8e80-4f12-a7ab-2d5ff6aa78ca None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.858738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069b67f-bb27-41e7-9307-52e0ae83b197 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:29.876100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.876728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.877004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.877268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.877922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:29.878219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:29.879585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:29.887736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 99/193] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:29.888329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.896069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:29.896674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:29.896950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:29.897221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:29.897880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:29.898179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:29.899547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:29.912354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 95/194] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:29.912354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:29.976216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:29.987194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa9bfb-eb37-4cca-88e1-414cefa681d1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.007986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ede2b-b6e5-4cf7-87b1-527bf0b3f366 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.019350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.019974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.020253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.020518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.021158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.022651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.032425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.043472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.044103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.044381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.044651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.045311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:30.045431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 100/195] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:29 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:30.045610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.046109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.046975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.074370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 96/196] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:30.074370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.158305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a5ca-feeb-447c-be61-436459390c0d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.184968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7dbfa-e654-4d14-b2a6-5f5029fdc2e1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.198669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.199417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.199700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.200025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] PATH_INFO: `/v3/users/b078310ff692432ca9bd02da1761cafa` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.218418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] RBAC: Authorizing `identity:get_user(user_id=b078310ff692432ca9bd02da1761cafa)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.219891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.221700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 101/197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/users/b078310ff692432ca9bd02da1761cafa => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:30.223140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.227261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.234727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.236300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.236786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.237374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] PATH_INFO: `/v3/users/b078310ff692432ca9bd02da1761cafa` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.238763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] RBAC: Authorizing `identity:get_user(user_id=b078310ff692432ca9bd02da1761cafa)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.240363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.242144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 97/198] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/users/b078310ff692432ca9bd02da1761cafa => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:30.242742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.311258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.353128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d26a1-39e9-4f9b-93a8-a463b1a5bd3d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.367402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5f0a-dbfb-4551-8b8e-782020bf11e8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.397760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.398404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.398775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.398962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] PATH_INFO: `/v3/users/1c32029fac7343ea99d3fcd9e54c9823` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.401406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] RBAC: Authorizing `identity:get_user(user_id=1c32029fac7343ea99d3fcd9e54c9823)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.402074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.403822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/users/1c32029fac7343ea99d3fcd9e54c9823 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:30.404698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.410865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.411483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.411829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.412148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.489641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.491351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.502868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.544721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e6cad-59a1-4fb5-82b1-94969e8f8246 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.553892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.597038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.598628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.599138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.599958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.612423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:30.613279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.690862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.692666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.734246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ab534-bfac-41bc-9d93-70df6ba689cd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.774394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.785096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.785717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.786001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.786280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.808478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 103/201] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:30.813163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:30.819142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:30.883542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.886281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.929041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fbd2b-be82-4827-91c9-615743fb5807 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:30.977401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:30.979103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:30.979594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:30.980102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:30.981528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:30.983517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:30.990922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 104/202] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:30.992151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:31.028380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 99/203] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:31.029904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:31.051769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:31.090367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:31.140004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12525c-a41f-4d45-a59b-79d58869c3ca None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:31.142822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dd374-f890-498c-816e-f9329bd9a726 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:31.180629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:31.182438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:31.182911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:31.183376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:31.184408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=b078310ff692432ca9bd02da1761cafa) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:31.184953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:31.186294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:31.186770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:31.187056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:31.187407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:31.187754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:31.188971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:31.191292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:31.198040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 105/204] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:30 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:31.198040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:31.199223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 100/205] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:31 2022] GET /identity/v3/role_assignments?user.id=b078310ff692432ca9bd02da1761cafa&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:31.201014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:31.317890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf07579-4b15-40b7-877c-4aecee15ecec None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:31.330604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:31.360165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:31.360794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:31.361075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:31.361349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:31.367963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:31.367963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:31.367963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 106/206] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:31 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:31.374482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:31.427248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2dbd2-fc65-4b05-83e0-18c353f1b4b1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:31.457590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:31.491376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:31.492616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:31.493351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:31.493815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:31.495033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] RBAC: Adding query filter params (role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=b078310ff692432ca9bd02da1761cafa) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:31.495621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:31.497325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008cd4-3f81-4c80-a945-54f7abf7250b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:31.507974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0cd1-c5b8-46c3-a203-378d8c4185e7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:31.513832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 101/207] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:31 2022] GET /identity/v3/role_assignments?user.id=b078310ff692432ca9bd02da1761cafa&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:31.541712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:31.542347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:31.542625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:31.542895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:31.543643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] RBAC: Adding query filter params (role.id=ee7c10e8a9914cd3a0a971b8c385f26c, scope.project.id=048cb71d8f1347878fd9a5a035ab7562, user.id=1c32029fac7343ea99d3fcd9e54c9823) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:31.543976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:31.545458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd511edc-24fb-476f-8738-c6462d836b4e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:31.556054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:31 2022] GET /identity/v3/role_assignments?user.id=1c32029fac7343ea99d3fcd9e54c9823&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=ee7c10e8a9914cd3a0a971b8c385f26c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:32.477147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36405-f0c8-47f8-9d54-02462052a9b8 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:32.478114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36405-f0c8-47f8-9d54-02462052a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:32.479130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36405-f0c8-47f8-9d54-02462052a9b8 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:32.480713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 102/209] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:32.486046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:32.486333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:32.486605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:32.500820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f5c3-8563-45da-af3c-9fc3354f3704 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:32.501101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f5c3-8563-45da-af3c-9fc3354f3704 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:32.501376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f5c3-8563-45da-af3c-9fc3354f3704 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:32.502700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 103/210] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:32.506320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:32.507506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:32.508166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:32.508648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:32.509112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:32.527308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:32.528836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:32.544251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:32.581274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 108/211] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:32.614398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:32.857244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:32.898636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:32.971926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe163c-a16e-4a12-b22c-3a24c58aa43c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:33.012352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:33.013003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.013279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.013563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.018875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf42405-6c21-491d-8c3e-73971ed7f68e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:33.024558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:33.030087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:33.030959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 109/213] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:33.037029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:33.041866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:33.070762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:33.071460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.071747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.072084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.073547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:33.075712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:33.082254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 105/214] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:33.082946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:33.083709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:33.156802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05325b7-070e-43b4-b5f6-dabfefc293e9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:33.192024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:33.195063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.195063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.195063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.195063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:33.195063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:33.195607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:33.204710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e05177-35b6-4113-ba70-2da73bcef3b1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:33.205191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 110/215] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:33.211575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:33.262540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:33.263812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.264219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.264639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.265428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:33.267689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:33.304098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 106/216] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:33 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:33.329168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:33.347915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af973-65c8-48e3-b2ec-5a8ca001337c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:33.393066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196596a-72b2-48dd-b8c6-bfa708a3ec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:33.394325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196596a-72b2-48dd-b8c6-bfa708a3ec90 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.394836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196596a-72b2-48dd-b8c6-bfa708a3ec90 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.395367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196596a-72b2-48dd-b8c6-bfa708a3ec90 None admin] PATH_INFO: `/v3/users/ad639da48d434d5db7c656dd06e25ee8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.413100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196596a-72b2-48dd-b8c6-bfa708a3ec90 None admin] RBAC: Authorizing `identity:get_user(user_id=ad639da48d434d5db7c656dd06e25ee8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:33.414884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196596a-72b2-48dd-b8c6-bfa708a3ec90 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:33.417537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 111/217] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:33 2022] GET /identity/v3/users/ad639da48d434d5db7c656dd06e25ee8 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:33.423477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:33.471884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:33.541578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b72cf-4efe-4f80-aa1f-4522045bc021 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:33.580160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:33.580782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.581066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.581345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.662973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:33.664613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:33.709077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:33.734527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0f55-f231-4f5c-ac01-02fbad685c9c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.735048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0f55-f231-4f5c-ac01-02fbad685c9c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.735048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0f55-f231-4f5c-ac01-02fbad685c9c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.736524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 112/218] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:33.741907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49681db8-b235-4702-8daa-ae8f583c71fd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.742186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49681db8-b235-4702-8daa-ae8f583c71fd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.742461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49681db8-b235-4702-8daa-ae8f583c71fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.770629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-49681db8-b235-4702-8daa-ae8f583c71fd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:33.773218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-49681db8-b235-4702-8daa-ae8f583c71fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:33.796963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 107/219] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:33.809330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:33.877104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 113/220] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:33.908899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368655-2e04-4fdf-9361-fd1499749a3a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.909223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368655-2e04-4fdf-9361-fd1499749a3a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.909442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368655-2e04-4fdf-9361-fd1499749a3a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.910856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 114/221] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:33.916010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:33.916219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:33.916450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:33.948928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:33.950304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:33.964384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597cb15-3796-40a2-9b98-b6f47789edc1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.001575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.002219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.002501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.002783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.003945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:34.005419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:34.007228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 108/222] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:33 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:34.014610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.024891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:34.108855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 115/223] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:34.122845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8914d-ef08-431b-a4aa-abe59b99ed3e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.156861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.157476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.157758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.158032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.158767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=ad639da48d434d5db7c656dd06e25ee8) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:34.159079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:34.160568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:34.166805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 109/224] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/role_assignments?user.id=ad639da48d434d5db7c656dd06e25ee8&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:34.213586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.226563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:34.345408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e1afb-c71d-428d-8d94-a8663e251f7f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.397058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.397720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.397996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.398265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.409852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:34.414906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:34.416378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:34.417220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 116/225] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:34.422401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.463022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.537778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:34.541659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:34.572981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c59b3-7f85-4fef-bd2a-46ece1c5faae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.610235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.611227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.611730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.612266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.619618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785f218-c833-429f-8f9d-ab2cfdc38503 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.628632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:34.638039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:34.638931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:34.639711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:34.643782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 117/226] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:34.649464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.685871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.686411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.686697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.686976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.687658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:34.688062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:34.689675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:34.699524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 110/227] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:34.706600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.813078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef4694-791b-42ad-a9b8-64be491b08b0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.839297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b2703-4383-4920-a6de-34d72a43492c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:34.848426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:34.852970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.854062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.854493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.855009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] PATH_INFO: `/v3/users/b078310ff692432ca9bd02da1761cafa` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.856513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] RBAC: Authorizing `identity:get_user(user_id=b078310ff692432ca9bd02da1761cafa)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:34.858403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:34.860749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 111/228] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/users/b078310ff692432ca9bd02da1761cafa => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:34.869245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:34.933496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:34.964767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:34.965304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:34.965579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:34.965849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:34.966515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:34.966813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:34.968206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:34.982491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 118/229] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:34.988494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:35.005108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce824ceb-1036-4c03-a388-45340d24e76e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:35.070015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:35.070665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:35.070943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:35.071218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:35.076638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:35.078198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:35.079884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 112/230] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:35.090774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:35.140773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbc191-77e7-4f5a-96b0-56174dc073d2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:35.212289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:35.218236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:35.219177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:35.219683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:35.220176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] PATH_INFO: `/v3/users/b078310ff692432ca9bd02da1761cafa` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:35.221523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] RBAC: Authorizing `identity:get_user(user_id=b078310ff692432ca9bd02da1761cafa)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:35.223153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:35.224996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 119/231] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:34 2022] GET /identity/v3/users/b078310ff692432ca9bd02da1761cafa => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:35.231646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:35.266696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d4d32-cba5-4ec5-8bc2-de506fa54b13 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:35.329505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:35.330524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:35.331085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:35.332079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/b078310ff692432ca9bd02da1761cafa/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:35.335803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] RBAC: Authorizing `identity:create_grant(project_id=b88672c51b8c45f2a58ab4c5abc84dfb, user_id=b078310ff692432ca9bd02da1761cafa, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:35.339258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:35.339499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:35.359761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 113/232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:35 2022] PUT /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/b078310ff692432ca9bd02da1761cafa/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:15:35.393271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde851-17d1-48b4-a3cc-33bbd9791e3e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:35.430629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42c5f4-c1c1-4d1b-a06c-dd3323f58f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:35.432368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42c5f4-c1c1-4d1b-a06c-dd3323f58f16 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:35.433035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42c5f4-c1c1-4d1b-a06c-dd3323f58f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:35.433736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42c5f4-c1c1-4d1b-a06c-dd3323f58f16 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:35.435737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42c5f4-c1c1-4d1b-a06c-dd3323f58f16 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:35.437472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42c5f4-c1c1-4d1b-a06c-dd3323f58f16 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:35.439460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 120/233] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:35 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:35.445542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:35.579556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536c436-83e3-4f29-8b56-84929381490f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:35.614432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:35.624146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66e70e-17b4-4e42-9f9e-17555c744162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:35.625562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e70e-17b4-4e42-9f9e-17555c744162 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:35.626033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e70e-17b4-4e42-9f9e-17555c744162 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:35.626522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e70e-17b4-4e42-9f9e-17555c744162 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/b078310ff692432ca9bd02da1761cafa/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:35.629034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66e70e-17b4-4e42-9f9e-17555c744162 None admin] RBAC: Authorizing `identity:create_grant(project_id=b88672c51b8c45f2a58ab4c5abc84dfb, user_id=b078310ff692432ca9bd02da1761cafa, role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:35.630668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66e70e-17b4-4e42-9f9e-17555c744162 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:35.652875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 114/234] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:35 2022] PUT /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/b078310ff692432ca9bd02da1761cafa/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:15:36.036279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9996a5c-5bb1-419f-9a44-84748de1abd7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:36.036818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9996a5c-5bb1-419f-9a44-84748de1abd7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:36.036818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9996a5c-5bb1-419f-9a44-84748de1abd7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:36.038427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 121/235] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:36.044856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191a5d-f10f-43f5-ac4b-f7218640201f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:36.045142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191a5d-f10f-43f5-ac4b-f7218640201f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:36.045418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd191a5d-f10f-43f5-ac4b-f7218640201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:36.063737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cd191a5d-f10f-43f5-ac4b-f7218640201f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:36.064970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cd191a5d-f10f-43f5-ac4b-f7218640201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:36.162468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:36.370583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc62b9-95e9-4190-afc6-a8a8c28d919f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:36.370946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc62b9-95e9-4190-afc6-a8a8c28d919f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:36.371135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc62b9-95e9-4190-afc6-a8a8c28d919f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:36.372866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 122/237] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:36.378139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:36.378429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:36.378705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:36.397411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:36.398596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:36.487290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 116/238] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:36.499831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc62b9-95e9-4190-afc6-a8a8c28d919f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:36.608068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc62b9-95e9-4190-afc6-a8a8c28d919f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:36.636071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:36.645678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:36.646373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:36.646651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:36.646924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:36.658409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:36.663429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:36.664367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:36.665279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 123/239] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:36.672349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:36.741079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:36.809231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc9e1a-48a9-4d98-b0a9-35c734762ed4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:36.866008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:36.866992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:36.867464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:36.868223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:36.869620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:36.870127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:36.871689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:36.878986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:36.886498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 117/240] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:36.892643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.015808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d987a9-fe1d-4427-8795-c00a7075f588 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.036827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08047f50-ef9b-423c-b82c-ab94a60e3f4a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.050440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:37.054253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62c127-fc44-43f6-9761-eb1398fc8985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.055834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c127-fc44-43f6-9761-eb1398fc8985 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.057232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c127-fc44-43f6-9761-eb1398fc8985 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.057711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c127-fc44-43f6-9761-eb1398fc8985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.059252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62c127-fc44-43f6-9761-eb1398fc8985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:37.060926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62c127-fc44-43f6-9761-eb1398fc8985 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:37.067476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 124/241] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:37.068992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3033c7d-913d-4dfa-a8d5-ac0cb45fd614 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.069417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3033c7d-913d-4dfa-a8d5-ac0cb45fd614 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.069826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3033c7d-913d-4dfa-a8d5-ac0cb45fd614 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.071455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 125/242] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:37.072500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3033c7d-913d-4dfa-a8d5-ac0cb45fd614 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.081561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636c924-d87b-42e3-b9ee-34d2ad0126e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.082302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636c924-d87b-42e3-b9ee-34d2ad0126e9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.083083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636c924-d87b-42e3-b9ee-34d2ad0126e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.083362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636c924-d87b-42e3-b9ee-34d2ad0126e9 None admin] PATH_INFO: `/v3/users/5bb94f824bda4f64859c34d7af4969a9` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.102031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636c924-d87b-42e3-b9ee-34d2ad0126e9 None admin] RBAC: Authorizing `identity:get_user(user_id=5bb94f824bda4f64859c34d7af4969a9)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:37.104682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636c924-d87b-42e3-b9ee-34d2ad0126e9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:37.108002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 118/243] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:36 2022] GET /identity/v3/users/5bb94f824bda4f64859c34d7af4969a9 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:37.109408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.109911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.110381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.133409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:37.135265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:37.142178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:37.200211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3033c7d-913d-4dfa-a8d5-ac0cb45fd614 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.216030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 119/244] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:37.223323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.237072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.237999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.238506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.238977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.239824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:37.241554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:37.269915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 126/245] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:37 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:37.357036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:37.361862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35fc4a-eca8-4ea4-94db-7e1f93f4e60b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.409356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.409888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.410166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.410437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.511818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:37.513365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:37.583976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.664032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 120/246] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:37.664464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:37.678563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.719827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60707282-37cd-4d08-8714-b697700f4d30 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.737447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:37.767836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.768510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.768778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.769168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.784657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:37.790131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:37.791042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:37.791806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:37.800434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 127/247] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:37.802347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.828622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25747188-4ab6-4e77-aa8c-4a70fae2b45b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.874029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.874781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.875058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.875327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.880542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:37.880542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:37.880542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 121/248] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:37 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:37.890180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:37.938511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd3dd-04d2-4ec7-afcc-f30230982dfb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:37.968825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:37.980735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:37.981776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:37.982279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:37.982767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:37.983818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:37.984354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:37.986039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:37.996757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 128/249] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:38.003486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:38.011450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd3f7e-f598-462d-9fac-77e7407f1e03 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:38.046078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:38.050512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:38.051183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.051495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.051874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.052681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] RBAC: Adding query filter params (role.id=ee7c10e8a9914cd3a0a971b8c385f26c, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=5bb94f824bda4f64859c34d7af4969a9) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:38.052987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:38.054419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:38.060734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 122/250] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:37 2022] GET /identity/v3/role_assignments?user.id=5bb94f824bda4f64859c34d7af4969a9&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=ee7c10e8a9914cd3a0a971b8c385f26c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:38.131383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45529c-e260-46f2-adf8-d6c7985f5167 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:38.175810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bd56-f194-487b-a387-64f182901bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:38.176904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd56-f194-487b-a387-64f182901bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.177427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd56-f194-487b-a387-64f182901bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.177924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd56-f194-487b-a387-64f182901bb0 None admin] PATH_INFO: `/v3/users/ad639da48d434d5db7c656dd06e25ee8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.179577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bd56-f194-487b-a387-64f182901bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=ad639da48d434d5db7c656dd06e25ee8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:38.181688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bd56-f194-487b-a387-64f182901bb0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:38.184532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 129/251] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:38 2022] GET /identity/v3/users/ad639da48d434d5db7c656dd06e25ee8 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:38.195588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:38.330729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387c3e-8b30-4ef0-9a6f-d6c2a1d76b11 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.331098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387c3e-8b30-4ef0-9a6f-d6c2a1d76b11 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.331299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387c3e-8b30-4ef0-9a6f-d6c2a1d76b11 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.332752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 130/252] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:38.333662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f2dd1-0ff7-40d7-9cef-30cefdb83059 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:38.340128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848daf2-f950-4e02-95bb-377feba99970 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.340439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848daf2-f950-4e02-95bb-377feba99970 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.340683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848daf2-f950-4e02-95bb-377feba99970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.368432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a848daf2-f950-4e02-95bb-377feba99970 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:38.370944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a848daf2-f950-4e02-95bb-377feba99970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:38.375362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:38.385043 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36cb62-60db-4546-8eb1-f0712b23f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:38.386023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36cb62-60db-4546-8eb1-f0712b23f1cd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.386552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36cb62-60db-4546-8eb1-f0712b23f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.387042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36cb62-60db-4546-8eb1-f0712b23f1cd None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.388614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36cb62-60db-4546-8eb1-f0712b23f1cd None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:38.390269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36cb62-60db-4546-8eb1-f0712b23f1cd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:38.392232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 123/253] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:38 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:38.393633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7762a1-bf96-4ab0-a7ce-50df8cc3b388 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.394178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7762a1-bf96-4ab0-a7ce-50df8cc3b388 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.394678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7762a1-bf96-4ab0-a7ce-50df8cc3b388 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.397125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 124/254] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:38.401915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7762a1-bf96-4ab0-a7ce-50df8cc3b388 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:38.469613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 131/255] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:38.475957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.476447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.477357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.515859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:38.517129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:38.555555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7762a1-bf96-4ab0-a7ce-50df8cc3b388 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:38.571777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:38.606524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:38.607550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:38.608038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:38.608526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/ad639da48d434d5db7c656dd06e25ee8/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:38.610674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] RBAC: Authorizing `identity:create_grant(project_id=b88672c51b8c45f2a58ab4c5abc84dfb, user_id=ad639da48d434d5db7c656dd06e25ee8, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:38.616572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:38.634075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 132/256] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:38.647881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 125/257] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:38 2022] PUT /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/ad639da48d434d5db7c656dd06e25ee8/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:38.830981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:38.961621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369ce17-2bb3-4df2-b7f0-88e72ac50015 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:38.999483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:39.000198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:39.000536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:39.000812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:39.015649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:39.020591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:39.021451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:39.022828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 133/258] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:39.027653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:39.095577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:39.133014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:39.159374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808585-4d25-48cf-8572-008e1228f716 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:39.179421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:39.239644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:39.240294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:39.241512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:39.241801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:39.242480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:39.242787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:39.245828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:39.276793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 126/259] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:39.282018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:39.356386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26bc1b-f10c-43c7-8b60-6e6207189ae3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:39.441185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:39.442104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:39.442527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:39.442937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:39.469447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:39.475186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:39.476339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:39.477307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:39.480678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d708ef9-2f42-4530-9666-1b87d123d58a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:39.483426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 134/260] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:39.494316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:39.525383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:39.568631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:39.569522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:39.569946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:39.570403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] PATH_INFO: `/v3/users/b078310ff692432ca9bd02da1761cafa` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:39.572099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] RBAC: Authorizing `identity:get_user(user_id=b078310ff692432ca9bd02da1761cafa)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:39.574285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:39.576213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 127/261] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:39 2022] GET /identity/v3/users/b078310ff692432ca9bd02da1761cafa => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:39.584535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:39.698081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:39.747643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0f330-b3fe-4a80-9031-7d3cfb5ea9ef None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:39.811965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bcdad-29cf-4dc9-b628-4566fd2a19d4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:39.838083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:39.838946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:39.839367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:39.839788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:39.840789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:39.841239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:39.842811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:39.862924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 135/262] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:39.869683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:39.890526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:39.890526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:39.890526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:39.890526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.017357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:40.052779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:40.054268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:40.124409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ad7b8-ca69-46a4-aa22-348548dd2eb8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:40.218969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:40.219688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.219894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.220197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] PATH_INFO: `/v3/users/b078310ff692432ca9bd02da1761cafa` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.222877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=b078310ff692432ca9bd02da1761cafa)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:40.224364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:40.226123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 136/263] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:39 2022] GET /identity/v3/users/b078310ff692432ca9bd02da1761cafa => generated 283 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:40.231740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:40.252938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:40.307034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 128/264] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 12:15:40.317039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:40.362591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f650243-22ce-41a7-9ae5-33cfda84bfc2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:40.402700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:40.403320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.403601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.403874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.483720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:40.485396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:40.503961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:40.559951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:40.582464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc537f82-9627-4ba0-9d79-9ed1b7954b9f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:40.600874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 137/265] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 12:15:40.606713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:40.654055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:40.654696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.654972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.655244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.659004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:40.660526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:40.662196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 129/266] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:40 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:40.668871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:40.712748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c10b2-c75e-4378-bca0-6189764d5b4a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:40.736641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:40.797605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:40.798260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.798539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.798812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.799958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:40.801445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:40.803468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 138/267] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:40 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:40.809693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:40.863271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59054dda-9f6e-440e-8d65-f89ef54558e4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:40.904316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:40.904924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.905200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.905473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.906626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=b078310ff692432ca9bd02da1761cafa) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:40.906935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:40.908418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05de0a-f2d0-45b7-9a80-261e71880608 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:40.916008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 130/268] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:40 2022] GET /identity/v3/role_assignments?user.id=b078310ff692432ca9bd02da1761cafa&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:40.917476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67a694-11da-4dba-a6f6-5b595d6fbfd0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.917757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67a694-11da-4dba-a6f6-5b595d6fbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.918311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67a694-11da-4dba-a6f6-5b595d6fbfd0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.919972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 131/269] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:40.926101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22ba3-02c9-4d9f-a3f1-821347330b28 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:40.926401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22ba3-02c9-4d9f-a3f1-821347330b28 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:40.926636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22ba3-02c9-4d9f-a3f1-821347330b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:40.957855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a5d22ba3-02c9-4d9f-a3f1-821347330b28 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:40.959056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a5d22ba3-02c9-4d9f-a3f1-821347330b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:40.989973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:41.029672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6890d-7b64-4616-8741-d3e507cbae94 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:41.108774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:41.109419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.109695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.109981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.110931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] RBAC: Adding query filter params (role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=b078310ff692432ca9bd02da1761cafa) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:41.111242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:41.112840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb47b8-8649-439a-b61e-fcd957ac559c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:41.115055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 132/270] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:41.121050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 139/271] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:40 2022] GET /identity/v3/role_assignments?user.id=b078310ff692432ca9bd02da1761cafa&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:41.219965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5045-fc05-44ee-a6a5-767b723cad77 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.220301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5045-fc05-44ee-a6a5-767b723cad77 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.220525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede5045-fc05-44ee-a6a5-767b723cad77 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.222010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 133/272] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:41.227728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.228823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.228897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.258214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:41.259875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:41.325466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd8b7-33e2-4bb1-ada4-0ba339fe3964 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.325795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd8b7-33e2-4bb1-ada4-0ba339fe3964 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.326018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcd8b7-33e2-4bb1-ada4-0ba339fe3964 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.331632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:41.331799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 134/273] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:41.333387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.333677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.333957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.354751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:41.355977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:41.377482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 140/274] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:41.434242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 135/275] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:41.559367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:41.675344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f11c1f-cb7d-4460-bae3-02e197c46026 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:41.677929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:41.723158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:41.724709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.725302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.725847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.739324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:41.746574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:41.747473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:41.748386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:41.749894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 141/276] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:41.755023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:41.784630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:41.798515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:41.805789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e28303-a307-42c4-a224-c319adf3a27c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:41.849066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:41.849710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.849988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.850258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.860723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:41.865522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:41.866428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 136/277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:41.869573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:41.881354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f4aa4-c241-45cb-8902-c92878c89967 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:41.916337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:41.916941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:41.917216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:41.917482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:41.918138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:41.918444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:41.919826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:41.933110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 142/278] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:41.933110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:41.978899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ee5d4-33cf-4074-bee3-15e56644a1d0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.015898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.017311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.017593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.017872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.019114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.020656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.022531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 137/279] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:42.023157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.034454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:42.039785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:42.046692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bb1ee-86a7-474a-b57b-e20d9ef5e79d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.081622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.082226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.082500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.082778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.083426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:42.083723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.085120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.093314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 143/280] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:42.094090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.131681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a53f9-b426-422d-a466-c09794c58cf7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.166132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.166788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.167067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.167344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] PATH_INFO: `/v3/users/ef27b0e93db24fdb8447ec04c80fc57f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.185090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ef27b0e93db24fdb8447ec04c80fc57f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.186470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.188169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 138/281] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:42 2022] GET /identity/v3/users/ef27b0e93db24fdb8447ec04c80fc57f => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:42.193213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.200952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a28ac-7342-4283-9246-f8f2ba28b1cb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.233779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382d88b-b1b3-4821-8364-d1761958e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.234377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d88b-b1b3-4821-8364-d1761958e33d None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.234645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d88b-b1b3-4821-8364-d1761958e33d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.234912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d88b-b1b3-4821-8364-d1761958e33d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.235550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d88b-b1b3-4821-8364-d1761958e33d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.237014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d88b-b1b3-4821-8364-d1761958e33d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.255749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:42.257665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 144/282] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:15:42 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:42.258855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1100-f5e4-4c72-9a73-43aabc839b43 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.259157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1100-f5e4-4c72-9a73-43aabc839b43 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.259426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc1100-f5e4-4c72-9a73-43aabc839b43 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.260683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 145/283] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:42.261357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1100-f5e4-4c72-9a73-43aabc839b43 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.280179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:42.303404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f654f-7b75-4951-bb03-9b33d20870c3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.340298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27fd4-a36f-48b4-afaa-d3da33a5e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.340993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27fd4-a36f-48b4-afaa-d3da33a5e965 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.341274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27fd4-a36f-48b4-afaa-d3da33a5e965 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.341555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27fd4-a36f-48b4-afaa-d3da33a5e965 None admin] PATH_INFO: `/v3/users/5bb94f824bda4f64859c34d7af4969a9` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.342721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a27fd4-a36f-48b4-afaa-d3da33a5e965 None admin] RBAC: Authorizing `identity:get_user(user_id=5bb94f824bda4f64859c34d7af4969a9)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.344223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a27fd4-a36f-48b4-afaa-d3da33a5e965 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.350603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 139/284] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:42 2022] GET /identity/v3/users/5bb94f824bda4f64859c34d7af4969a9 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:42.350603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.350603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.350603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.366099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:42.367302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:42.387697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc1100-f5e4-4c72-9a73-43aabc839b43 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.426443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.427149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.427498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.427852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.429357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, user.id=ef27b0e93db24fdb8447ec04c80fc57f, scope.system=all) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:42.429357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.430511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.436590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 146/285] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 22 12:15:42 2022] GET /identity/v3/role_assignments?user.id=ef27b0e93db24fdb8447ec04c80fc57f&scope.system=all&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:42.437409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.441887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 140/286] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:42.541183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:42.566709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb91d3-2e3a-4623-aa6d-0efed34f0dc3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.607281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.608011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.608293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.608625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.610249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.611732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.613643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 147/287] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:42 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:42.619482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.692294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:42.730043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:42.738070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3062f3-28ab-4042-ad23-ec78dd980e6a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.776500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.777174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.777453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.777725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/5bb94f824bda4f64859c34d7af4969a9/roles/ee7c10e8a9914cd3a0a971b8c385f26c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.779809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] RBAC: Authorizing `identity:create_grant(project_id=b88672c51b8c45f2a58ab4c5abc84dfb, user_id=5bb94f824bda4f64859c34d7af4969a9, role_id=ee7c10e8a9914cd3a0a971b8c385f26c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:42.781341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:42.806677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 141/288] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:15:42 2022] PUT /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/users/5bb94f824bda4f64859c34d7af4969a9/roles/ee7c10e8a9914cd3a0a971b8c385f26c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:42.856399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cf77e-fe7b-498d-8ced-09981e9435ee None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:42.893141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:42.894240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:42.894721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:42.895188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:42.907437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:42.913410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:42.914351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:42.915342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:42.918274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 148/289] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:42.924528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:43.060828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc37e6-1485-428b-9435-6034247e8f22 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:43.086698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:43.099563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:43.100228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:43.100715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:43.101164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:43.102075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:43.102381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:43.103800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:43.112699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 142/290] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:43.119012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:43.132999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:43.287703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04139da-32e7-481d-b334-4c451b482edf None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:43.332635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:43.333192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:43.333467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:43.333730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] PATH_INFO: `/v3/users/ad639da48d434d5db7c656dd06e25ee8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:43.336636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] RBAC: Authorizing `identity:get_user(user_id=ad639da48d434d5db7c656dd06e25ee8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:43.338704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:43.340322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 149/291] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:43 2022] GET /identity/v3/users/ad639da48d434d5db7c656dd06e25ee8 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:43.346126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:43.490762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65952b-038d-470c-a899-b024e9a3c5e4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:43.539610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:43.540289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:43.540575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:43.540852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:43.615100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:43.633673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:43.635760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:43.765755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 143/292] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:43.773221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:43.892437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:43.923047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a8c89-69a7-4765-9a3c-89c36bf14356 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:43.968625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c034-a1be-4109-a24a-a34037adb2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:43.969254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c034-a1be-4109-a24a-a34037adb2ff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:43.969529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c034-a1be-4109-a24a-a34037adb2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:43.969797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c034-a1be-4109-a24a-a34037adb2ff None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:43.970917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c034-a1be-4109-a24a-a34037adb2ff None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:43.972389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801c034-a1be-4109-a24a-a34037adb2ff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:43.974316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 150/293] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:43 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:43.980713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:44.108665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:44.117322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fab2f-7005-47ac-aa4e-0d72d9a28ebb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:44.153181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:44.153714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:44.153995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:44.154268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:44.154994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=ad639da48d434d5db7c656dd06e25ee8) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:44.155303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:44.156767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5112b-104b-4d13-9af6-c036741a3969 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:44.167707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 144/294] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:43 2022] GET /identity/v3/role_assignments?user.id=ad639da48d434d5db7c656dd06e25ee8&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:45.080439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225685f6-ceb9-46e6-889f-4c28a2ec0bc5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.080983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225685f6-ceb9-46e6-889f-4c28a2ec0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.080983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225685f6-ceb9-46e6-889f-4c28a2ec0bc5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.082304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 151/295] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:45.088234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5c0c-4fde-4b21-a499-487d2791f70b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.088679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5c0c-4fde-4b21-a499-487d2791f70b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.088784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5c0c-4fde-4b21-a499-487d2791f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.108194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-272b5c0c-4fde-4b21-a499-487d2791f70b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:45.109394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-272b5c0c-4fde-4b21-a499-487d2791f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:45.130789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91f693-c992-401b-b178-8462267e900d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.131070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91f693-c992-401b-b178-8462267e900d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.131339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91f693-c992-401b-b178-8462267e900d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.133249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 152/296] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:45.138327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd336e-caa1-4c42-8290-3210ab93b07d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.138607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd336e-caa1-4c42-8290-3210ab93b07d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.138873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd336e-caa1-4c42-8290-3210ab93b07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.157659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-45bd336e-caa1-4c42-8290-3210ab93b07d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:45.158844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-45bd336e-caa1-4c42-8290-3210ab93b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:45.184214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 145/297] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:45.185901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e990-2064-449c-ae5a-9b6f291648e7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.186197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e990-2064-449c-ae5a-9b6f291648e7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.186477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35e990-2064-449c-ae5a-9b6f291648e7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.187724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 146/298] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:45.199409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829c94-0a36-4d2f-ae63-00fa7836a43e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.199711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829c94-0a36-4d2f-ae63-00fa7836a43e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.200001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829c94-0a36-4d2f-ae63-00fa7836a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.218951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-dc829c94-0a36-4d2f-ae63-00fa7836a43e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:45.220459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dc829c94-0a36-4d2f-ae63-00fa7836a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:45.248574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 153/299] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:45.305363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 147/300] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:45.460910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38ac9-ed72-48d3-8823-dc36ad087997 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.461205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38ac9-ed72-48d3-8823-dc36ad087997 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.461468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38ac9-ed72-48d3-8823-dc36ad087997 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.463681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 154/301] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:45.468811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.469107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.469385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.487557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:45.488632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38ac9-ed72-48d3-8823-dc36ad087997 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:45.490064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:45.494013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:45.559406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 148/302] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:45.563993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:45.576972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:45.606704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38ac9-ed72-48d3-8823-dc36ad087997 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:45.645081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:45.645717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.645998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.646271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.657344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:45.662236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:45.663130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:45.663900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 155/303] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:45.664600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:45.676937 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd535a-d4c6-4aa8-906c-decccc69eb71 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:45.714105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:45.714867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.714992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.715199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.716339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:45.717800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:45.719479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 149/304] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:45.720116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:45.731421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:45.772503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae7cc5-b630-4f05-9129-b9a50be5dc01 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:45.805625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:45.811453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:45.812113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.812396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.812668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.825985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:45.828746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1486a0-98f4-4ba4-9da8-85faffb50e34 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:45.831647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:45.833010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 156/305] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:45.833908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:45.869037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:45.869640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.869919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.870189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.870848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:45.871152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:45.872550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:45.880375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 150/306] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:45.885719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:45.934806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f619-fcca-43ad-89c1-e50cc5d63341 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:45.946277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:45.968392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:45.968942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:45.969224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:45.969498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] PATH_INFO: `/v3/groups` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:45.970120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:45.971555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:45.978665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90e1d3-69d5-44b7-b40f-76bcea78c2c3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:45.986992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 157/307] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Sep 22 12:15:45 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:15:45.987788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.016831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.017495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.017799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.018076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.029933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:46.035540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:46.036518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:46.037310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 151/308] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:46.038753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.053139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:46.108005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb4e9-853e-4328-887b-26cd8e7a5ce4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.150407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.150765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b947603-b332-4158-9207-aacc4b600092 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.151230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.151309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.151565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.152515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:46.152816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.155066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.171004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 158/309] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:46.171961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.183581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:46.202225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.202886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.203165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.203439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] PATH_INFO: `/v3/users/149221b76d584c7296079dfcfc2fb6a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.219030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] RBAC: Authorizing `identity:get_user(user_id=149221b76d584c7296079dfcfc2fb6a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.220527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.222351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 152/310] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/users/149221b76d584c7296079dfcfc2fb6a3 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:46.222941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.283453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b606b-62b9-4f76-b029-a46de1065442 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.297775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:46.318606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.319226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.319509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.319777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.320488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:46.320788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.322194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.335069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 159/311] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:46.335069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.341267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615df4-4c33-4ff6-9664-429a6e1b3b78 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.377099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.377821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.378171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.378513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] PATH_INFO: `/v3/users/ef27b0e93db24fdb8447ec04c80fc57f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.380018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] RBAC: Authorizing `identity:get_user(user_id=ef27b0e93db24fdb8447ec04c80fc57f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.381519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.387913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 153/312] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/users/ef27b0e93db24fdb8447ec04c80fc57f => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:46.387913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.443727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3154b0-b9d4-4c7f-a2ea-2b386ac61615 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.447257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:46.479588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.480149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.480428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.480700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.481431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] RBAC: Adding query filter params (role.id=ee7c10e8a9914cd3a0a971b8c385f26c, user.id=149221b76d584c7296079dfcfc2fb6a3, scope.system=all) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:46.481736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.483179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.490206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 160/313] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/role_assignments?user.id=149221b76d584c7296079dfcfc2fb6a3&scope.system=all&role.id=ee7c10e8a9914cd3a0a971b8c385f26c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:46.491166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.500482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a197d-a22d-475c-b778-b34f38051a28 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.548110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.549160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.549614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.550058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] PATH_INFO: `/v3/users/5bb94f824bda4f64859c34d7af4969a9` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.551679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] RBAC: Authorizing `identity:get_user(user_id=5bb94f824bda4f64859c34d7af4969a9)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.553655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:46.554791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.563121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 154/314] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/users/5bb94f824bda4f64859c34d7af4969a9 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:46.565024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:46.634911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07fef-ba5e-469d-9067-4e98b79cd834 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.690265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.691517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.692213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.692709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] PATH_INFO: `/v3/system/users/ef27b0e93db24fdb8447ec04c80fc57f/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.695076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef27b0e93db24fdb8447ec04c80fc57f, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.697527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.700548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26074-c4aa-4431-a320-6951c8383f4a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:46.709334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 161/315] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Sep 22 12:15:46 2022] PUT /identity/v3/system/users/ef27b0e93db24fdb8447ec04c80fc57f/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:46.729984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:46.742694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:46.743624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:46.743902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:46.744205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:46.821029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:46.823079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:46.932392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 155/316] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:46.938321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:47.049752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f1e8c-31c4-4a9e-a236-6b4a5655d914 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:47.052188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:47.091348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceef91-b743-47cd-bf85-f94e2830bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:47.092406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceef91-b743-47cd-bf85-f94e2830bc50 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:47.092903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceef91-b743-47cd-bf85-f94e2830bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:47.093406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceef91-b743-47cd-bf85-f94e2830bc50 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:47.094752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceef91-b743-47cd-bf85-f94e2830bc50 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:47.096420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceef91-b743-47cd-bf85-f94e2830bc50 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:47.098605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 162/317] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:46 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:47.105314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:47.130729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:47.212367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880e575-53e2-4353-94bb-ed592fe2c4f3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:47.247835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:47.248573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:47.248862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:47.249137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:47.249866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] RBAC: Adding query filter params (role.id=ee7c10e8a9914cd3a0a971b8c385f26c, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb, user.id=5bb94f824bda4f64859c34d7af4969a9) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:47.250171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:47.251629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083660f-a286-47ed-af1e-81eaf0dc6b4c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:47.261602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 156/318] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:15:47 2022] GET /identity/v3/role_assignments?user.id=5bb94f824bda4f64859c34d7af4969a9&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=ee7c10e8a9914cd3a0a971b8c385f26c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:48.285333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851bc9d-8ef9-4655-bf73-016ce15a0e89 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.285830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851bc9d-8ef9-4655-bf73-016ce15a0e89 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.285902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851bc9d-8ef9-4655-bf73-016ce15a0e89 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.287379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 163/319] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:48.292427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913678a-1aca-456f-a651-8e62d375ecb9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.292797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913678a-1aca-456f-a651-8e62d375ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.292983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913678a-1aca-456f-a651-8e62d375ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.311602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a913678a-1aca-456f-a651-8e62d375ecb9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:48.312814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a913678a-1aca-456f-a651-8e62d375ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:48.378709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 157/320] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:48.648402 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851bc9d-8ef9-4655-bf73-016ce15a0e89 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:48.718962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8fe41-1e8b-42be-b428-e0beaffd2ec6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.719240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8fe41-1e8b-42be-b428-e0beaffd2ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.719511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8fe41-1e8b-42be-b428-e0beaffd2ec6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.720891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 158/321] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:48.725935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210850-842f-4f17-950c-dd8b50992c10 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.726219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210850-842f-4f17-950c-dd8b50992c10 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.726495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87210850-842f-4f17-950c-dd8b50992c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.745342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-87210850-842f-4f17-950c-dd8b50992c10 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:48.746771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-87210850-842f-4f17-950c-dd8b50992c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:48.759636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851bc9d-8ef9-4655-bf73-016ce15a0e89 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:48.760741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:48.793945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:48.794698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.794981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.795252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.796384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:48.797817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:48.799553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 164/322] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:48.804838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:48.824421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 159/323] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:48.853145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:48.913730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784027ee-80e9-4a28-9a89-2ff41230d9ee None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:48.945135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94f59-a990-4b94-a25f-1f484c1d01fe None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.945411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94f59-a990-4b94-a25f-1f484c1d01fe None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.945689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94f59-a990-4b94-a25f-1f484c1d01fe None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.948100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 160/324] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:15:48.948376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:48.949031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.949323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.949565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] PATH_INFO: `/v3/groups` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.950168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:48.951624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:48.954186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:48.954680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:48.954902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:48.976237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 165/325] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Sep 22 12:15:48 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:15:48.982065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:48.983277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:49.059478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 161/326] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:49.099911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.206516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:49.210681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048aabb-35b1-4b2b-90e5-a45f5c7f817d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.248630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.249294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.249576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.249847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.261194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:49.266513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:49.267385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:49.268583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 166/327] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:49.274074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.329722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.372107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:49.401315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584618-43ed-4321-a97d-2d8ef235fee8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.448072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.449126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.449281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.449671 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.450420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:49.450782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:49.451906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78aceb-0e4a-4bfc-8326-da49cf7e3756 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.452283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:49.465357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 162/328] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:49.470260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.499480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.500487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.500975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.501306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.513111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:49.518516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:49.519405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:49.520512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 167/329] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:49.525820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.551522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:49.604641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cc5b8-02c3-4097-9893-4f75cc4efa2e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.642479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c36538-67b5-40d0-8c75-4ff8415d4d25 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.642990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.643695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.644080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.644414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] PATH_INFO: `/v3/users/149221b76d584c7296079dfcfc2fb6a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.645623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] RBAC: Authorizing `identity:get_user(user_id=149221b76d584c7296079dfcfc2fb6a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:49.647133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:49.649165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 163/330] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/users/149221b76d584c7296079dfcfc2fb6a3 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:49.654433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.666394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:49.685630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.686695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.687172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.687609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.688481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:49.689118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:49.690839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:49.702562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 168/331] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:49.708860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:49.803782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21937a-075b-4f53-ae75-4baba027e14a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.830061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:49.859793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae14fa-e6ad-40a6-9525-352b28d88480 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:49.867289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.868296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.869092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.869371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] PATH_INFO: `/v3/system/users/149221b76d584c7296079dfcfc2fb6a3/roles/ee7c10e8a9914cd3a0a971b8c385f26c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.870825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=149221b76d584c7296079dfcfc2fb6a3, role_id=ee7c10e8a9914cd3a0a971b8c385f26c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:49.872495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:49.892763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 164/332] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Sep 22 12:15:49 2022] PUT /identity/v3/system/users/149221b76d584c7296079dfcfc2fb6a3/roles/ee7c10e8a9914cd3a0a971b8c385f26c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:49.908373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a9114-f8b0-4890-8dcb-48f75dac4334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:49.909364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9114-f8b0-4890-8dcb-48f75dac4334 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:49.909823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9114-f8b0-4890-8dcb-48f75dac4334 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:49.910288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9114-f8b0-4890-8dcb-48f75dac4334 None admin] PATH_INFO: `/v3/users/ef27b0e93db24fdb8447ec04c80fc57f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:49.911633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9114-f8b0-4890-8dcb-48f75dac4334 None admin] RBAC: Authorizing `identity:get_user(user_id=ef27b0e93db24fdb8447ec04c80fc57f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:49.913341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9114-f8b0-4890-8dcb-48f75dac4334 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:49.916240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 169/333] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/users/ef27b0e93db24fdb8447ec04c80fc57f => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:49.922160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:50.005152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:50.053121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed05ed0-70ed-437f-81df-b7ff682a5031 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:50.096391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:50.097407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:50.097886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:50.098375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:50.099341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] RBAC: Adding query filter params (role.id=1c178a8418b14b00ae66f630cb16a8a3, user.id=ef27b0e93db24fdb8447ec04c80fc57f, scope.system=all) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:50.099856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:50.101586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f28895-733b-4157-9a46-68e28a866364 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:50.119445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 165/334] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 22 12:15:49 2022] GET /identity/v3/role_assignments?user.id=ef27b0e93db24fdb8447ec04c80fc57f&scope.system=all&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:51.414740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ac6c2-9cbb-407e-b0a7-f817abc7f69d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:51.415312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ac6c2-9cbb-407e-b0a7-f817abc7f69d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:51.415312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ac6c2-9cbb-407e-b0a7-f817abc7f69d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:51.416953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 170/335] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:51.423024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:51.423455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:51.423627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:51.442130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:51.443327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:51.527509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 166/336] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:15:51.823844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ac6c2-9cbb-407e-b0a7-f817abc7f69d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:51.944784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ac6c2-9cbb-407e-b0a7-f817abc7f69d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:51.980358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:51.980999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:51.981279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:51.981554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:51.992826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:51.998641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:51.999507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:52.000893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 171/337] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:52.005683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:52.101320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:52.152127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfaf56-73a4-4a86-bfa0-008e50ff5e72 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:52.195107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:52.195107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.195107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.195107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.195504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:52.195504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:52.196430 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8331e9-672f-4c25-afe3-3dca167fd60f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:52.214252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 167/338] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:52.221868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:52.240067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:52.348650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519d02-e8a2-40e2-b655-bcf406180174 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:52.391908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:52.392578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.392861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.393139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.466875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:52.468388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:52.494562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:52.509627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5c546-a41b-46eb-b5b4-1d6b88e351a1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.510157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5c546-a41b-46eb-b5b4-1d6b88e351a1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.510157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5c546-a41b-46eb-b5b4-1d6b88e351a1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.511516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 168/339] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:52.520303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479f62d-1672-4485-994a-e27484792264 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.520584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479f62d-1672-4485-994a-e27484792264 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.520858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479f62d-1672-4485-994a-e27484792264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.557548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0479f62d-1672-4485-994a-e27484792264 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:52.558754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0479f62d-1672-4485-994a-e27484792264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:52.577334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 172/340] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:52.604274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:52.663731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 169/341] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:52.721322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75d089-8a1a-46b5-8600-aefb72d9bdf7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:52.738554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:52.777463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10bca-eb07-48ad-a2ca-ef7435aa327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:52.778112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10bca-eb07-48ad-a2ca-ef7435aa327b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.778389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10bca-eb07-48ad-a2ca-ef7435aa327b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.778661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10bca-eb07-48ad-a2ca-ef7435aa327b None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.779794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10bca-eb07-48ad-a2ca-ef7435aa327b None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:52.781407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10bca-eb07-48ad-a2ca-ef7435aa327b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:52.783412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 173/342] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:52 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:52.788677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479f62d-1672-4485-994a-e27484792264 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:52.856795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:52.907137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479f62d-1672-4485-994a-e27484792264 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:52.936357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642390-3e91-4fc0-8e88-a6841ebdd26d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.936896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642390-3e91-4fc0-8e88-a6841ebdd26d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.937341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642390-3e91-4fc0-8e88-a6841ebdd26d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.939098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 174/343] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:52.943986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ede46-5502-4f85-a6b7-eef7c4ad627d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.944349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ede46-5502-4f85-a6b7-eef7c4ad627d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.944709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ede46-5502-4f85-a6b7-eef7c4ad627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.956913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:52.957849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:52.958305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:52.958819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:52.970841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:52.972764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:52.974939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 170/344] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:52 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:52.980800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:52.983639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a45ede46-5502-4f85-a6b7-eef7c4ad627d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:52.985691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a45ede46-5502-4f85-a6b7-eef7c4ad627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:53.092222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 175/345] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:53.093556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549dd23-a170-4619-b313-492648324460 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.093840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549dd23-a170-4619-b313-492648324460 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.094180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549dd23-a170-4619-b313-492648324460 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.095683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 176/346] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:53.096453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549dd23-a170-4619-b313-492648324460 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:53.142687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bca50-76c5-4d50-9eb4-7a066a385f68 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:53.172617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:53.208441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:53.209256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.209677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.210112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.210986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=048cb71d8f1347878fd9a5a035ab7562) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:53.211435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:53.213544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dee4fb-5b52-410a-964c-aec305e4e42a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:53.224492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 171/347] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:15:52 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:53.225720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.226005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.226279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.261032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:53.262248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:53.267753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549dd23-a170-4619-b313-492648324460 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:53.282725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:53.337307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da362405-9433-4995-8234-153d3ded528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:53.338244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da362405-9433-4995-8234-153d3ded528a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.338744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da362405-9433-4995-8234-153d3ded528a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.339217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da362405-9433-4995-8234-153d3ded528a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.358426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 172/348] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:53.359228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da362405-9433-4995-8234-153d3ded528a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-da362405-9433-4995-8234-153d3ded528a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:53.364866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:53.365807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:53.366592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:53.369564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 177/349] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:53.375064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:53.433033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da362405-9433-4995-8234-153d3ded528a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:53.506817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006ed09-0c04-4448-bd79-8e5a079e14c6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:53.518442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:53.569664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:53.570568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.570995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.571449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.572300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:53.572754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:53.574345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:53.587951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 173/350] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:53.593214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:53.609015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da362405-9433-4995-8234-153d3ded528a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:53.679574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:53.681114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.681543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.681963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.705212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:53.708649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4941e6-c435-4b4d-812a-945e7e0eda02 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:53.711114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:53.712263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 12:15:53.713263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:53.715991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 178/351] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:53.724555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:53.751026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:53.751643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:53.751922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:53.752219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:53.773904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:53.804560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:53.829904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:53.831716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:53.940626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 174/352] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:53.941709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:53.943803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45171bd-bdec-487d-8290-7e66fb47b555 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.020661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.021534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.021966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.022079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:54.022504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.023319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:54.023768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.025994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.040876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 179/353] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.042002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.049974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca7f4-5d5b-4822-a469-285c22db9581 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.090067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.090758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.091040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.091312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.105504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:54.111482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:54.112636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:54.113624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:54.115063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 175/354] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:54.116009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.254764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:54.275259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52b0c-f0ad-432c-8214-27aca3096968 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.310696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fb8e0-e11a-4fcb-b57f-cb3c602197c1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.320879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.322214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.323196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.323853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.325289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.326886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.328538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 180/355] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.329392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.361311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:54.367802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6717c-582b-4144-82be-96c9ed734c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.369012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6717c-582b-4144-82be-96c9ed734c7e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.369729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6717c-582b-4144-82be-96c9ed734c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.370149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6717c-582b-4144-82be-96c9ed734c7e None admin] PATH_INFO: `/v3/users/149221b76d584c7296079dfcfc2fb6a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.372251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6717c-582b-4144-82be-96c9ed734c7e None admin] RBAC: Authorizing `identity:get_user(user_id=149221b76d584c7296079dfcfc2fb6a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.374747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6717c-582b-4144-82be-96c9ed734c7e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.377227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 176/356] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/users/149221b76d584c7296079dfcfc2fb6a3 => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.379187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548333-e1ed-4463-aacb-a15f9969aa07 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.379751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548333-e1ed-4463-aacb-a15f9969aa07 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.380195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548333-e1ed-4463-aacb-a15f9969aa07 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.381991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 177/357] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:54.382975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548333-e1ed-4463-aacb-a15f9969aa07 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.464494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760de58c-e20d-479f-a54b-70d3d43141fe None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.511530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.512418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.512840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.513413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.514259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:54.514702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.514850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548333-e1ed-4463-aacb-a15f9969aa07 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.516635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.528294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 181/358] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.529726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.557990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:54.562446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3ce63-cd4f-418e-8d44-7ce3a4dc07de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.562959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3ce63-cd4f-418e-8d44-7ce3a4dc07de None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.563400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3ce63-cd4f-418e-8d44-7ce3a4dc07de None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.563772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3ce63-cd4f-418e-8d44-7ce3a4dc07de None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.565154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3ce63-cd4f-418e-8d44-7ce3a4dc07de None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.566751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3ce63-cd4f-418e-8d44-7ce3a4dc07de None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.568773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 178/359] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.569988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.570406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.576585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.598096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:54.599187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:54.672362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:54.674152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d031ba-a216-4d13-a719-c2f4d78fba4f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.678696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 179/360] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:54.679685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.716908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.717766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.718209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.718693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.719551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] RBAC: Adding query filter params (role.id=ee7c10e8a9914cd3a0a971b8c385f26c, user.id=149221b76d584c7296079dfcfc2fb6a3, scope.system=all) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:54.720448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.722322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.737232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 182/361] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/role_assignments?user.id=149221b76d584c7296079dfcfc2fb6a3&scope.system=all&role.id=ee7c10e8a9914cd3a0a971b8c385f26c => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.738632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:54.837897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:54.864081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52067887-293b-4b3a-9f24-cfcd31726a46 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:54.905400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:54.906314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.906753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.907164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.908095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=048cb71d8f1347878fd9a5a035ab7562) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:54.908612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:54.910547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc349d-a9c9-4cb1-8075-060171e80a0b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:54.919294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 183/362] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:54.920990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0637f-f996-4419-a8a3-db5a519558f3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.921421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0637f-f996-4419-a8a3-db5a519558f3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.921834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0637f-f996-4419-a8a3-db5a519558f3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.923629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 184/363] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:54.936157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:54.936660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:54.937093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:54.961994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:54.963585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:54.964214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c5e98-e451-4cbd-9386-f69c2fcccc29 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.032941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.033586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.033869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.034128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.089141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 185/364] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:55.095702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.135892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:55.142188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:55.143833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:55.228936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:55.264103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f48bf-655f-4e46-b833-758a971ea030 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.288048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 180/365] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:55.293870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.319057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.319702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.320155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.320378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.343173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:55.350351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:55.351225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:55.352061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 186/366] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:55.361327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.482900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:55.490859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ee8da-3a11-4381-a8c9-bb382cdd120c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.531573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.532691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.533117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.533863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.535436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:55.536529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d90449-1088-4176-84ca-ff2331aae276 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.537325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:55.541094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 181/367] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:55.542037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.576783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:55.585232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.586248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.587149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.588582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.589539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:55.590054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:55.591669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:55.603611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 187/368] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:55.605390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.674796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c643-5182-441a-9265-7179d5cb2147 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.717078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.718149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.719431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.719872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.733827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:55.739079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:55.740152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:15:55.741078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:15:55.741753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8b40c-5988-4c77-aa06-ba44aea61f5d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.743885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 182/369] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:55.744930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.778882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:55.791566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.792330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.792610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.792882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.795632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:55.797380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:55.799263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 188/370] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:55.799855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.874154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b93ea-fdb1-47c8-905d-088a98f5d3ba None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.881132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:55.915312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.915954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.916241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.916514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.926941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6829-05fd-42d4-a845-238f887e20dc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:55.963633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:55.964766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:55.965258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:55.965740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:55.966619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:55.967130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:55.968764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:55.979397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 189/371] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:55.981522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:55.996520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:55.998078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.044431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:56.112822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e923f-502e-4ff2-8634-13507d3cba36 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:56.132721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 183/372] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:56.135156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:56.142512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:56.155725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:56.156397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.156681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.156958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.157707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:56.158040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:56.159559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.166154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 190/373] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:15:55 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:56.167125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:56.272359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160219cf-896a-4799-b250-71c0cd69ef1b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:56.295602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480656-d1c1-4a15-9d67-e137455f07c7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:56.312734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:56.325379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4474d-cd08-42ef-8e8b-d2ed1500755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:56.326257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4474d-cd08-42ef-8e8b-d2ed1500755f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.326687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4474d-cd08-42ef-8e8b-d2ed1500755f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.327189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4474d-cd08-42ef-8e8b-d2ed1500755f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.346152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb704-f904-4024-86bc-948671bfc51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:56.346984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb704-f904-4024-86bc-948671bfc51e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.347376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb704-f904-4024-86bc-948671bfc51e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.347789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb704-f904-4024-86bc-948671bfc51e None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.350055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb704-f904-4024-86bc-948671bfc51e None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:56.352162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb704-f904-4024-86bc-948671bfc51e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.355228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 191/374] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:56 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:56.356728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671420aa-5fc4-4406-9789-82788c50ae98 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.357238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671420aa-5fc4-4406-9789-82788c50ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.358285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671420aa-5fc4-4406-9789-82788c50ae98 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.360060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 192/375] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:56.361244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671420aa-5fc4-4406-9789-82788c50ae98 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:56.416894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4474d-cd08-42ef-8e8b-d2ed1500755f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:56.418311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4474d-cd08-42ef-8e8b-d2ed1500755f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.448759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:56.511063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671420aa-5fc4-4406-9789-82788c50ae98 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:56.555064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 184/376] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:15:56.556323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:56.557152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.557298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.557579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.557744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.558013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.558360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.559132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:56.560973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.562651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 193/377] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:56 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:56.563328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:56.584638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:56.586283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:56.612491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:56.685415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 185/378] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:56.685415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:56.746189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6a387-2998-4e0c-b9f5-292835cc86f5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:56.805061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:56.807713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43702181-6a6f-4649-b78c-b6778675f4d1 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:56.834057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:56.834700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.834982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.835256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] PATH_INFO: `/v3/projects/d1d2459aef21456aad8510f367ebb7a7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.839954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d2459aef21456aad8510f367ebb7a7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:56.839954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.840505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 194/379] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:56 2022] GET /identity/v3/projects/d1d2459aef21456aad8510f367ebb7a7 => generated 344 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:56.846994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:56.872542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:56.873855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:56.874320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:56.874818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:56.875728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:56.876688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:56.878772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:56.892990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 186/380] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:15:56 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:56.998561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a34a-59f5-4998-80a0-5b5b8365fda8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:57.040597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:57.041248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.041523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.041795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] PATH_INFO: `/v3/groups/af2116f6da7d49d58ddf9fff70c52951` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.048539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] RBAC: Authorizing `identity:get_group(group_id=af2116f6da7d49d58ddf9fff70c52951)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:57.050080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:57.051804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 195/381] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:56 2022] GET /identity/v3/groups/af2116f6da7d49d58ddf9fff70c52951 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:15:57.058235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:57.085977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:57.111089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:57.192994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d8c59-e11b-4052-9386-4824cc2adee5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:57.216613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:57.263810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:57.265363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.265644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.265913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.266642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] RBAC: Adding query filter params (group.id=af2116f6da7d49d58ddf9fff70c52951, role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=d1d2459aef21456aad8510f367ebb7a7) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:57.266947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:57.268445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:57.284810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 187/382] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:15:57 2022] GET /identity/v3/role_assignments?group.id=af2116f6da7d49d58ddf9fff70c52951&scope.project.id=d1d2459aef21456aad8510f367ebb7a7&role.id=972430f30d6d40b1b22793c8952f489e => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:57.300202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834e69-ebe3-4b25-a62f-ec3d205b7c0e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:57.338159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:57.338828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.339108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.339381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.351361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:57.357474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:57.358438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:57.359289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 196/383] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:15:57.368526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:57.501738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:57.518910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eee10-ae70-47a2-a2b8-d70f05d2c450 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:57.561092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:57.561711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.561987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.562259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.562919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:57.563278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:57.564736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:57.573219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 188/384] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:57.578915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:57.701317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0737481-862b-4f8d-b669-e624c6505874 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:57.718860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:57.742741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22924c-a08a-49e3-bf01-26e2fc3e3522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:57.743720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22924c-a08a-49e3-bf01-26e2fc3e3522 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.744020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22924c-a08a-49e3-bf01-26e2fc3e3522 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.744290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22924c-a08a-49e3-bf01-26e2fc3e3522 None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.745463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22924c-a08a-49e3-bf01-26e2fc3e3522 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:57.746902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22924c-a08a-49e3-bf01-26e2fc3e3522 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:57.749778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 197/385] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:57 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:57.754370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:57.832448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4a84-2865-4a51-a69a-c817da51b07c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.832753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4a84-2865-4a51-a69a-c817da51b07c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.832942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4a84-2865-4a51-a69a-c817da51b07c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.834500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 198/386] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:57.842696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.842996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.843289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.878934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794547fc-6a91-429e-ac68-370e5f43272c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:57.885746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:57.886141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:57.918696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:57.919700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:57.920236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:57.920718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:57.922414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:57.924169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:57.930932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 189/387] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:57 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:57.932595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:57.952346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:58.026668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 199/388] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:58.047692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f52de5-47d9-4172-b26c-e3782bfe9c16 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:58.082632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:58.083709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:58.084294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:58.084793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:58.087747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] RBAC: Authorizing `identity:create_grant(project_id=048cb71d8f1347878fd9a5a035ab7562, group_id=6cf784710bd044e3b0ed3b8fece7c645, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:58.089432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:58.112097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 190/389] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 22 12:15:57 2022] PUT /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:15:58.369950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:58.482683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87eba5-1924-4f04-bba8-0bd7a7063db7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:58.508295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:58.527029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:58.527664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:58.527956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:58.528244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:58.548822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:15:58.553705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:15:58.554625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:15:58.557083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 200/390] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:15:58.561078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:58.677323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:58.690729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4655-84af-46a6-a85a-125f7088484d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:58.726832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:58.727854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:58.728458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:58.728958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:58.729879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:15:58.730404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:58.732012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:58.741354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 191/391] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:58.749326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:58.885554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df43f-e36d-42a2-a3cb-9fc80165268d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:58.927017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:58.927714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:58.927961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:58.928235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:58.929373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:58.930859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:58.932782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 201/392] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:15:58 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:58.937991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:59.065787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3013-a535-40f9-bb9d-7f41ffaeb103 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:59.104265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a7540-3873-4860-9963-33c1c30c1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:59.105313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7540-3873-4860-9963-33c1c30c1218 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:59.105796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7540-3873-4860-9963-33c1c30c1218 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:59.106270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7540-3873-4860-9963-33c1c30c1218 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:59.108814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a7540-3873-4860-9963-33c1c30c1218 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:59.110481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a7540-3873-4860-9963-33c1c30c1218 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:59.112791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 192/393] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:15:58 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:15:59.120647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:59.184439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:59.263455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485d990-e0f5-44f6-8cf6-890248f8da05 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:15:59.316852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4822-dd8b-4dc3-9212-e12527d5d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:15:59.317558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4822-dd8b-4dc3-9212-e12527d5d4ea None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:59.317837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4822-dd8b-4dc3-9212-e12527d5d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:59.318112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4822-dd8b-4dc3-9212-e12527d5d4ea None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:59.320523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4822-dd8b-4dc3-9212-e12527d5d4ea None admin] RBAC: Authorizing `identity:create_grant(project_id=048cb71d8f1347878fd9a5a035ab7562, group_id=6cf784710bd044e3b0ed3b8fece7c645, role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:15:59.322595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4822-dd8b-4dc3-9212-e12527d5d4ea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:15:59.345465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 202/394] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 22 12:15:59 2022] PUT /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:15:59.427727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51d55-c646-4b44-a504-0e2c2c82162d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:59.429699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51d55-c646-4b44-a504-0e2c2c82162d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:59.429699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51d55-c646-4b44-a504-0e2c2c82162d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:59.430165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 193/395] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:59.436536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:59.437071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:59.437487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:59.465276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:59.466806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:15:59.558617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 203/396] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:15:59.900801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af9f7-fd98-43d1-a6d6-006915cc262b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:59.901296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af9f7-fd98-43d1-a6d6-006915cc262b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:59.901703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af9f7-fd98-43d1-a6d6-006915cc262b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:59.903630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 194/397] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:15:59.904756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:15:59.922216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803908dc-df94-45f3-b6ed-18f4425a2cdd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:15:59.922842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803908dc-df94-45f3-b6ed-18f4425a2cdd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:15:59.923398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803908dc-df94-45f3-b6ed-18f4425a2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:15:59.933005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:59.942016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:15:59.952995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-803908dc-df94-45f3-b6ed-18f4425a2cdd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:15:59.954211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-803908dc-df94-45f3-b6ed-18f4425a2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:00.035790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7bd64-f036-40e8-a98e-02f2dfdf51a5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.046294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 195/398] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:00.047644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8d9cf-953b-4051-addf-24d0c30c48a9 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.047924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8d9cf-953b-4051-addf-24d0c30c48a9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.048212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8d9cf-953b-4051-addf-24d0c30c48a9 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.050864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 196/399] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:00.055356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.055635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.055904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.076887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:00.078066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:00.100069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.100718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.104161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.104494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.126619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:00.141532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:00.142478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:00.143268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 204/400] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:15:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:00.153965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.219155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 197/401] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:00.287024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:00.296901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108acd66-0277-491e-80b9-2bc74b662db0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.336533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.337653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.337936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.338212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.338882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:00.339184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:00.340596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:00.349415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 205/402] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:00.355063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.419257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.456323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:00.495334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e9f0d-ede0-4e31-8207-f360f3d8ce6b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.533757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.534660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.535094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.535510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.537329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:00.539202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:00.542243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 198/403] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:00.543396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.564162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff611af2-b18e-44f6-a8fb-7ecb13af3927 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.600276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.601189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.601619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.602148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.613806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:00.620372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:00.621422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:00.622424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:00.624577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 206/404] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:00.625531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.646934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:00.659581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfdfdd-0770-4eec-971f-991b3d38fbfa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.693481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:00.698463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.699134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.699386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.699663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.713221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:00.718131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:00.719029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:00.719817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 199/405] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:00.720509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.749000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88587d3-d797-4074-b280-67a774ee95a0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.784618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.785542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.786036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.786493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.787829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:00.789530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:00.792074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 207/406] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:00.798029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.832791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980141-0ce6-4f0b-93e2-0ad2f1b01726 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.870997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.871604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.871880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.872196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.872952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:00.873253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:00.874768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:00.889820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 200/407] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:00.889820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:00.894936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:00.917593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e351eca-4047-4a88-a6d5-e731d0d163c0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:00.953214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:00.954223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:00.954761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:00.955243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:00.956154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:00.956690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:00.958269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:00.967336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 208/408] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:00.968446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.014968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614435f7-6775-49df-8bf5-d94d92a2d7c6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.036472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:01.056809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.057565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.057848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.058120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.060387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] RBAC: Authorizing `identity:create_grant(project_id=b88672c51b8c45f2a58ab4c5abc84dfb, group_id=6cf784710bd044e3b0ed3b8fece7c645, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.062248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.078943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfcc0-a5d9-4740-8c5a-a0d083771dbb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.088023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 201/409] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 22 12:16:00 2022] PUT /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:01.088023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.152318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.153413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.153965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.154449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] PATH_INFO: `/v3/groups/af2116f6da7d49d58ddf9fff70c52951` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.156790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] RBAC: Authorizing `identity:get_group(group_id=af2116f6da7d49d58ddf9fff70c52951)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.158536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.160448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 209/410] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:00 2022] GET /identity/v3/groups/af2116f6da7d49d58ddf9fff70c52951 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:01.176402 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.208458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:01.228052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71899f-8d59-49da-a222-2383963d563f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.244268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:01.269426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4402-8c3a-4527-a0d9-b4569352da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.270143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4402-8c3a-4527-a0d9-b4569352da7c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.270430 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4402-8c3a-4527-a0d9-b4569352da7c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.270765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4402-8c3a-4527-a0d9-b4569352da7c None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.272096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e4402-8c3a-4527-a0d9-b4569352da7c None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.273682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e4402-8c3a-4527-a0d9-b4569352da7c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.276024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 202/411] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:01 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:01.277514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d55b-1196-4349-af58-966b549e468c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.277853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d55b-1196-4349-af58-966b549e468c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.278133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6d55b-1196-4349-af58-966b549e468c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.279707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 203/412] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:01.288088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.288531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.288961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.313332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:01.314721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:01.351661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e2f29-f53b-454d-b921-dd68f0c0d358 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.394042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.394674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.394954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.395227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] PATH_INFO: `/v3/projects/d1d2459aef21456aad8510f367ebb7a7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.396945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] RBAC: Authorizing `identity:get_project(project_id=d1d2459aef21456aad8510f367ebb7a7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.398386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.400401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 210/413] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:01 2022] GET /identity/v3/projects/d1d2459aef21456aad8510f367ebb7a7 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:01.401170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.418125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 204/414] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:01.418125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.554994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5fae-abfa-49fa-acb6-3a8acb685591 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.572167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:01.586846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:01.597571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.598572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.598843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.599123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] PATH_INFO: `/v3/projects/d1d2459aef21456aad8510f367ebb7a7/groups/af2116f6da7d49d58ddf9fff70c52951/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.601129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d2459aef21456aad8510f367ebb7a7, group_id=af2116f6da7d49d58ddf9fff70c52951, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.603073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.622414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 205/415] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 22 12:16:01 2022] PUT /identity/v3/projects/d1d2459aef21456aad8510f367ebb7a7/groups/af2116f6da7d49d58ddf9fff70c52951/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:01.630597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571db43-b17b-499e-979f-e92d20484c2e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.670827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.671463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.671741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.672059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.673271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.674882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.677241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 211/416] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:01 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:01.685492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.747653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.860316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cf006-8f2b-4f6b-a952-2e056314992a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.882310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cdc7f-693b-4d6c-9c89-d0c75eb3b801 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:01.910551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.911194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.911470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.911738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.923103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:01.923908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:01.925037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:01.925559 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:01.926242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:01.929074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] RBAC: Authorizing `identity:create_grant(project_id=b88672c51b8c45f2a58ab4c5abc84dfb, group_id=6cf784710bd044e3b0ed3b8fece7c645, role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:01.929282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:01.930298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:01.931593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 212/417] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:01.935421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:01.937523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:01.950149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:01.954382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 206/418] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 22 12:16:01 2022] PUT /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb/groups/6cf784710bd044e3b0ed3b8fece7c645/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:02.095445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9e6d3-6a7e-4cae-ba9a-bc6e3b082fb7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:02.138484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:02.139113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:02.139394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:02.139666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:02.140459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:02.140823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:02.142221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ae8ce-01d9-4aa2-8add-61ef8ef676e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:02.152895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 213/419] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:02.158442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:02.205805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:02.235681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04f233-1f03-4713-8a64-f20a4c0cfc48 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:02.236022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04f233-1f03-4713-8a64-f20a4c0cfc48 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:02.236307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04f233-1f03-4713-8a64-f20a4c0cfc48 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:02.237847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 214/420] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:02.243828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:02.244135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:02.244393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:02.266087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:02.268720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:02.303551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f11be-2ae5-4c4b-b9e8-391db502f199 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:02.342396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:02.343587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:02.344101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:02.344623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:02.350627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:02.364054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 215/421] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:02.420924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:02.422312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:02.452838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:02.536061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 207/422] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:02.542044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:02.692713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6692363-b95f-4d3d-a375-256217d8dffa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:02.737943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:02.738931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:02.739408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:02.739899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:02.741285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:02.743020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:02.749660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 216/423] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:02 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:02.751300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:02.804779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:02.925668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:02.927300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e295dc-e16a-48d0-b8ca-75ef11d5f435 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:02.982145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:02.989505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:02.990151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:02.990427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:02.990699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.000904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:03.001151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414295c-5436-4b51-9810-56a84a24472a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:03.002482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:03.004377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 208/424] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:02 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:03.011478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:03.046635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:03.047334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.047666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.047956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.066837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:03.074560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:03.075428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:03.076225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:03.077211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 217/425] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:03.083086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:03.186104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70638-a4b7-4c2c-b81b-a341b81b14aa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:03.247890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:03.248588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.249162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.249438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.250182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=048cb71d8f1347878fd9a5a035ab7562) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:03.250488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:03.251978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:03.265090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 209/426] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:16:03 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:03.267020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de4e46-d533-4ba1-9d37-12b6c4ff2275 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:03.312152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:03.328398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:03.328398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.328398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.328770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.329334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:03.329633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:03.332082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bcacb-0bc1-4f2e-9d31-64b717f09350 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:03.346464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 218/427] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:03.352893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:03.443055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:03.500076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a40ac-721c-4b16-97b0-b3f02eef3c58 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:03.551780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:03.552465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.552748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.553025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.618310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08d8ac-8512-4f21-8bcd-c95a38292427 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.618648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08d8ac-8512-4f21-8bcd-c95a38292427 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.618864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08d8ac-8512-4f21-8bcd-c95a38292427 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.620478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 219/428] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:03.627579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.627876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.628166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.642889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:03.644769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:03.650186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:03.651365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:03.717165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:03.756041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 220/429] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:03.765558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 210/430] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:03.770773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:03.875277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34631af7-814c-4a9a-bbfb-db425cb1659c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:03.896147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:03.912502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:03.913135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:03.913411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:03.913684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] PATH_INFO: `/v3/projects/048cb71d8f1347878fd9a5a035ab7562` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:03.915368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] RBAC: Authorizing `identity:get_project(project_id=048cb71d8f1347878fd9a5a035ab7562)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:03.916819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:03.918781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 221/431] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:03 2022] GET /identity/v3/projects/048cb71d8f1347878fd9a5a035ab7562 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:03.924929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.030154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a49f9e-7e0f-4f6c-a898-ee2fb181f06e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:04.053967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.073038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:04.074065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.075440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.075918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.079122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:04.081434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:04.084046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 211/432] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:03 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:04.090062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.129306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:04.219588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf7df4-af23-43c9-b522-e8e120c65b10 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:04.231338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27d4c-64b7-4cde-9d9c-ae5d31a11b65 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:04.268255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:04.268899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.269173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.269440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.281341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:04.281881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.282156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.282425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.283159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=048cb71d8f1347878fd9a5a035ab7562) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:04.283450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:04.285080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:04.288527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:04.292665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 212/433] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:16:04 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=048cb71d8f1347878fd9a5a035ab7562&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:04.295109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:04.296051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:04.296847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 222/434] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:04.304456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.418627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:04.426302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f953764-2be9-47a5-a980-14736a364521 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:04.466077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:04.467028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.467511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.467979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.468852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:04.469334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:04.470941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095764e-cc3f-40bd-b0f7-b552a93a1456 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:04.481591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 213/435] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:16:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:04.487209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.510635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be87b5-feda-4dfe-9f4d-33687809a34c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.510935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be87b5-feda-4dfe-9f4d-33687809a34c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.513022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be87b5-feda-4dfe-9f4d-33687809a34c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.513022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 214/436] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:04.519043 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ad34-ceca-4ba2-aa9c-ebb85e3c121e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.519325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ad34-ceca-4ba2-aa9c-ebb85e3c121e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.519987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ad34-ceca-4ba2-aa9c-ebb85e3c121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.542136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8723ad34-ceca-4ba2-aa9c-ebb85e3c121e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:04.542136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8723ad34-ceca-4ba2-aa9c-ebb85e3c121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:04.551043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:04.621346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a4694-f8fb-4817-aed3-4b1b8a45f975 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:04.624830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 215/437] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:04.659056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:04.660089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.660571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.661036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.672693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08512-d74c-42c7-89d3-ff384fa46eeb None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.672973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08512-d74c-42c7-89d3-ff384fa46eeb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.673252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08512-d74c-42c7-89d3-ff384fa46eeb None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.678352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 216/438] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:04.679675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:04.680009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:04.680816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:04.702760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:04.704007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:04.740670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:04.742153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:04.796107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 217/439] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:04.800282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:04.867154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 223/440] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:04.873928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.893168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:04.904731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:04.979655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beea4f3-81e4-41fc-b05b-7f13fdb9d206 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.008108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62475e13-c22c-4542-9f7b-8f3ecd448029 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.015826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.016506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.016787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.017062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.018241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.020143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.021963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 218/441] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:04 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:05.027084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.042980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.043450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.043734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.044030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.054508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:05.059860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:05.060882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:05.061702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 224/442] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:05.064150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.076062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.117832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.133782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64717d1e-84a6-4cdc-ad80-7fedd7db2261 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.163531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b1a6c-ccc5-477b-a3c3-b2dbdb9c0c0e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.168128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.168755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.169033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.169303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.170415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.171844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.173459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 219/443] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:05.174209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.203282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.203911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.204225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.204481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.214950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:05.219755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:05.220736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 225/444] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:05.221628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.273813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0a70-f3a6-446f-8f55-b3e667950a08 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.287852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.309184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.309725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.310001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.310269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.310920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:05.311224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.312619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.320494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 220/445] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:05.321301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.322986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd97e-68af-43b6-a29c-92d3f3d77b08 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.340771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.357874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.358471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.358746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.359017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.359734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=1c178a8418b14b00ae66f630cb16a8a3, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:05.360067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.361489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.367045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 226/446] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=1c178a8418b14b00ae66f630cb16a8a3 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:05.367840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.438861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80125e8-8093-40ff-b365-996f296ff553 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.475980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.476608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.476893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.477212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.477893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:05.478200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.479593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.480818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb5daf-b4bd-4538-b124-038c61b00dcd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.488596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 221/447] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:05.494828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.521242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.528411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.529134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.529487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.529835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.585991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.610678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.612432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a14ec-d755-4e15-9726-2fda41045602 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.612798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.656980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.658038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.658326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.658665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.732576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 227/448] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:05.739325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.743610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.745330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.771209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.821503 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.842088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addeb6c0-4a32-404c-a127-2ea48aeb375e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.843532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 222/449] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 12:16:05.849083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.877081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.877708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.877987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.878257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] PATH_INFO: `/v3/projects/d1d2459aef21456aad8510f367ebb7a7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.879377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d2459aef21456aad8510f367ebb7a7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.880839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.882589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 228/450] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/projects/d1d2459aef21456aad8510f367ebb7a7 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:05.888352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:05.946761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfdfdb-9413-4de2-a3c3-1f2bfe78398a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.979235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:05.980155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:05.980437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:05.980710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] PATH_INFO: `/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:05.981843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] RBAC: Authorizing `identity:get_project(project_id=b88672c51b8c45f2a58ab4c5abc84dfb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:05.982360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:05.983706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:05.985443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 223/451] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/projects/b88672c51b8c45f2a58ab4c5abc84dfb => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:05.985776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e91529-52b9-4ffa-ac90-1cf9f3109927 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:05.990883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:06.020625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:06.021253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:06.021522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:06.021801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] PATH_INFO: `/v3/groups/af2116f6da7d49d58ddf9fff70c52951` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:06.022913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] RBAC: Authorizing `identity:get_group(group_id=af2116f6da7d49d58ddf9fff70c52951)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:06.024471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:06.026038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 229/452] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/groups/af2116f6da7d49d58ddf9fff70c52951 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:06.031684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:06.037617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:06.089689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6027f1-47dc-4700-ae03-5b589e6099d4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:06.123595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:06.124247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:06.124530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:06.124805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] PATH_INFO: `/v3/groups/6cf784710bd044e3b0ed3b8fece7c645` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:06.125927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] RBAC: Authorizing `identity:get_group(group_id=6cf784710bd044e3b0ed3b8fece7c645)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:06.127362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:06.128082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18576fc5-2b75-4f48-ac60-a9c1896788ee None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:06.128959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 224/453] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 22 12:16:05 2022] GET /identity/v3/groups/6cf784710bd044e3b0ed3b8fece7c645 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:06.135251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:06.162144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:06.162743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:06.163025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:06.163300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:06.164050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] RBAC: Adding query filter params (group.id=af2116f6da7d49d58ddf9fff70c52951, role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=d1d2459aef21456aad8510f367ebb7a7) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:06.164363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:06.165792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa260eea-a725-4f9d-8cff-0165ebbed0a2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:06.171368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 230/454] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:16:06 2022] GET /identity/v3/role_assignments?group.id=af2116f6da7d49d58ddf9fff70c52951&scope.project.id=d1d2459aef21456aad8510f367ebb7a7&role.id=972430f30d6d40b1b22793c8952f489e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:06.240890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd87b-a753-4910-8db2-5c07f475b7ca None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:06.256829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:06.278144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:06.278843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:06.279034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:06.279307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:06.280076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] RBAC: Adding query filter params (group.id=6cf784710bd044e3b0ed3b8fece7c645, role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:06.280390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:06.281839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0fb3d-9938-4d92-886a-2669e022ca85 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:06.288262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 225/455] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 22 12:16:06 2022] GET /identity/v3/role_assignments?group.id=6cf784710bd044e3b0ed3b8fece7c645&scope.project.id=b88672c51b8c45f2a58ab4c5abc84dfb&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:09.171708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822eb2e-ef20-4da2-ab20-e086e7b23d42 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.172269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822eb2e-ef20-4da2-ab20-e086e7b23d42 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.172379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822eb2e-ef20-4da2-ab20-e086e7b23d42 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.174435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 231/456] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:09.174543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d16d21-d29b-4ce4-8cba-93c3f22175aa None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.174898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d16d21-d29b-4ce4-8cba-93c3f22175aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.175217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d16d21-d29b-4ce4-8cba-93c3f22175aa None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.177375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 226/457] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:09.179873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb327-ceda-443f-959f-d0535e48ff4f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.181002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb327-ceda-443f-959f-d0535e48ff4f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.181002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bb327-ceda-443f-959f-d0535e48ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.183229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de85ca-832e-4d51-90ef-701afa66e540 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.183517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de85ca-832e-4d51-90ef-701afa66e540 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.183797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de85ca-832e-4d51-90ef-701afa66e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.217587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-54de85ca-832e-4d51-90ef-701afa66e540 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:09.218799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-54de85ca-832e-4d51-90ef-701afa66e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:09.221836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-223bb327-ceda-443f-959f-d0535e48ff4f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:09.223006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-223bb327-ceda-443f-959f-d0535e48ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:09.278541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:09.349393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 227/458] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:09.370946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 232/459] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:09.544877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa656f-e01e-489d-bddf-f0123531d157 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.545219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa656f-e01e-489d-bddf-f0123531d157 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.545401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa656f-e01e-489d-bddf-f0123531d157 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.546962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 228/460] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:09.558156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.558446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.558720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.582452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:09.583683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:09.673437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa656f-e01e-489d-bddf-f0123531d157 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:09.674065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 233/461] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:09.717476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:09.806689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa656f-e01e-489d-bddf-f0123531d157 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:09.816608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:09.832186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:09.841715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d61b2-3542-4c0b-ac6e-8db759cc047e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:09.846552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:09.847208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.847483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.847750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.859186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:09.861216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-bc2626b0-5825-4121-a449-b7dd5b1ba2c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:09.876897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:09.877961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:09.879253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:09.879253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:09.879253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:09.881332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:09.882101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.882451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.882978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.883216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 229/462] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:09.884475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e199ed-abb5-404c-a2ec-d9f71da20fa5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.884858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e199ed-abb5-404c-a2ec-d9f71da20fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.885136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e199ed-abb5-404c-a2ec-d9f71da20fa5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.886636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 230/463] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:09.887163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e199ed-abb5-404c-a2ec-d9f71da20fa5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:09.893774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:09.895307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-68328a84-b182-47f8-b530-8656ae51b502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:09.910785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:09.912907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 234/464] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:09.915502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:09.939746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:09.940980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:10.005673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e199ed-abb5-404c-a2ec-d9f71da20fa5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.020191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 235/465] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:10.020965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.050242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.051907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.052408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.053110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.054212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:10.055123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.057226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.078275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 231/466] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:10.079105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.110754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.115396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.146040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961b109-1c11-4ca1-b0b9-61543647a11c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.189336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.191126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.191585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.192266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.193094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:10.193657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.196463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.210528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 236/467] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:10.210731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd934ce-c52c-4136-9a4a-105e4de4f556 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.212659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.259515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.260678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.261743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.262024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.277990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.280424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:10.300045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:10.300953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:10.301789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:10.301789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:10.301789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:10.308440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 232/468] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:10.309409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.324851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f08fab-685f-496c-8985-48ff44f08df9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.361895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.362498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.362772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.363037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.363676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.365286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.374860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.384235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.390383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 237/469] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:16:10 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:10.392772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.418177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37f30f-dbb5-4661-bc4d-1650ee37d878 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.456963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.457629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.457922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.458189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.458860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.460379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.493782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 233/470] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:16:10 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:10.497899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.546208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dba43b-f253-43cb-9732-0598b4a5ef4c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.612001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.612629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.612918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.613196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.613853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:10.614161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.615536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a498ec-b1e0-48df-9083-a6638543c77e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.623355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce8ff-4903-4627-a058-27a6a267fec7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.636980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 238/471] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:10.638755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172355bd-59bf-4b5b-9ffd-f16f429d0819 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.639256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172355bd-59bf-4b5b-9ffd-f16f429d0819 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.639821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172355bd-59bf-4b5b-9ffd-f16f429d0819 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.641666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 239/472] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:10.642690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172355bd-59bf-4b5b-9ffd-f16f429d0819 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.657475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.667527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.669013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.669013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.669013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.683008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.685297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6cd4d2ae-f3da-4085-b2cc-7fc386515b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:10.706765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:10.707756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:10.708625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:10.708625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:10.708625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:10.710078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 234/473] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:10.711289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.711289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.711452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.720121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.735104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:10.737472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:10.790545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172355bd-59bf-4b5b-9ffd-f16f429d0819 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.820196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 235/474] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:10.821556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:10.830926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.831536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.831857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.832198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.832842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.834316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:10.866782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 240/475] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:16:10 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:10.944922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e065fe-561c-4477-8391-b18193e2f084 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:10.957708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:10.985540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:10.986163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:10.986439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:10.986715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:10.987424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:10.987728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:10.989160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:11.003521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 236/476] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:11.009081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:11.142080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877652a-f805-4873-b20a-0b9f861614ce None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:11.151574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:11.177554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:11.184631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:11.185250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:11.185531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:11.185812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:11.186463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:11.187898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:11.224095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 241/477] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:16:11 2022] POST /identity/v3/users => generated 249 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:16:11.321610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efaeaa-543e-4339-a647-ac924c108820 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:11.360755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:11.361394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:11.361676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:11.361953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:11.362634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:11.364084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:11.374448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.sql.core [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 12:16:11.374448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 12:16:11.374448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [parameters: {'id': '4c30161134d5444fa2b69f7cbce2611a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 12:16:11.374448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81380) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application conn.query(q) Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result.read() Sep 22 12:16:11.392000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return ref.to_dict() Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 12:16:11.392994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application next(self.gen) Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application yield resource Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application next(self.gen) Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise self.value Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application session.commit() Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 12:16:11.393910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.session.flush() Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application compat.raise_( Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 12:16:11.394773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 12:16:11.395659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application conn.query(q) Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result.read() Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 12:16:11.396523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [parameters: {'id': '4c30161134d5444fa2b69f7cbce2611a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:11.397376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 12:16:11.404287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:11.406415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 237/478] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 22 12:16:11 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:11.406554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:11.525390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd853-9c27-4fe8-a418-cc6d18cad0b5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:11.564238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d079e4-8e9f-4806-a7a5-eff3ec2d1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:11.564893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d079e4-8e9f-4806-a7a5-eff3ec2d1195 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:11.565218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d079e4-8e9f-4806-a7a5-eff3ec2d1195 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:11.565500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d079e4-8e9f-4806-a7a5-eff3ec2d1195 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:11.577878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d079e4-8e9f-4806-a7a5-eff3ec2d1195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-53d079e4-8e9f-4806-a7a5-eff3ec2d1195 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:11.583258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:11.585392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:11.587852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 242/479] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:11.590883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:11.640323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:11.700401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01560a16-11a2-41ce-b9e7-16ab466e2386 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:11.735516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:11.736556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:11.737041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:11.737528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:11.738391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:11.738951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:11.740575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95a5ea-5ffd-44d8-86c3-ff7af7b63b18 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:11.750602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 238/480] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:13.100189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd798b0-b1e3-4947-99ee-5ec97d81456d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.100705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd798b0-b1e3-4947-99ee-5ec97d81456d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.100705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd798b0-b1e3-4947-99ee-5ec97d81456d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.102986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 243/481] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:13.108270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.108688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.108861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.132250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:13.133492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:13.162666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7fa9f-3b19-4745-93d5-5131779607db None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.162995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7fa9f-3b19-4745-93d5-5131779607db None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.163215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7fa9f-3b19-4745-93d5-5131779607db None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.165588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 244/482] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:13.171576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.172034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.172425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.235111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 239/483] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:13.236456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:13.237878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:13.257334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:13.337759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 245/484] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:13.534321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:13.565505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:13.660421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a2840-ce39-4fa8-8bdb-e33a6cf58f13 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:13.700097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:13.709814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:13.710482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.710763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.711041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.732854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:13.737809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:13.738694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:13.740077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 240/485] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:13.744981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:13.835172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06ca3-bd92-4a09-beca-19ecd3873370 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:13.873232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:13.880684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eb04b-045c-4f61-82ee-d4841073f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:13.881334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb04b-045c-4f61-82ee-d4841073f589 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.881669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb04b-045c-4f61-82ee-d4841073f589 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.882045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb04b-045c-4f61-82ee-d4841073f589 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.892782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89028c-d7aa-46e9-9bc2-b7a074fe9633 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:13.893783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eb04b-045c-4f61-82ee-d4841073f589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1c1eb04b-045c-4f61-82ee-d4841073f589 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:13.899787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:13.900898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:13.901721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:13.902456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 246/486] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:13.906616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec5fb-0511-4645-8f82-c4b419a97600 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.906616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec5fb-0511-4645-8f82-c4b419a97600 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.906616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dec5fb-0511-4645-8f82-c4b419a97600 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.906616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 247/487] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:13.911514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec5fb-0511-4645-8f82-c4b419a97600 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:13.927452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:13.944307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:13.944930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.945206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.945472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.946682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:13.946982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:13.948381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1654555-3758-4ed4-bf88-5ef2b7b9ae06 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:13.956844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 241/488] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:13.958131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:13.958420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:13.958692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:13.977437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:13.978595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:14.028812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dec5fb-0511-4645-8f82-c4b419a97600 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.048462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 242/489] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:14.049330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.066776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.067770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.068265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.068744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.069591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:14.070081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.072171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.087657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 248/490] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:14.089684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.139925 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:14.163891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de62c6-c78b-4aae-af13-f664adb8275a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.188273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:14.209046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.210002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.210488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.210951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.222832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.224304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.230618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1da07-5c08-4b7c-b8ad-95e263164f73 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:14.239498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:14.240447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:14.241279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:14.241279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:14.241279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:14.241279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 243/491] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:14.247077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.276552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.277712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.278429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.278924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.292909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.295105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:14.315965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:14.316911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:14.317744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:14.317744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:14.317744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:14.319945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 249/492] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:14.329817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.397096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bd2ca-05d7-4f8e-a1b8-99b25a4f543e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.455722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:14.470103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.470717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.470989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.471255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.471898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:14.472220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.473594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.496666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 244/493] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:14.500940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.516279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48589c08-a4d9-463e-948f-69d4bc949cae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.543880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:14.555039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.556175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.556495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.556705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.557350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:14.557648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.559032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.575895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 250/494] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:14.576986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.612828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4245ed-6c75-471c-ac00-e883f9dce28c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.654364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.655279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.655748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.656217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.663979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.665950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-85bdd62e-0c4e-4b66-bc74-9ad0bd1314b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:14.679557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:14.681366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:14.682255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 245/495] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:14.682824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a015-d93a-41aa-8ef8-3afc6dc5385f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.682824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a015-d93a-41aa-8ef8-3afc6dc5385f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.682824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a015-d93a-41aa-8ef8-3afc6dc5385f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.688272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 246/496] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:14.688272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84a015-d93a-41aa-8ef8-3afc6dc5385f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.688470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8b170-13b3-422c-89ab-bdd5a0d20391 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.723578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.724238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.724512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.724780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.735581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:14.740412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:14.740546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:14.741414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:14.742305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 251/497] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:14.743852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.791438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84a015-d93a-41aa-8ef8-3afc6dc5385f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.794136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:14.824858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.825478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.825750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.826019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.833146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.834593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1194cb59-c0a4-449b-b592-b83e413dce0f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:14.845832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:14.846885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 12:16:14.847836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:14.848612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b719-4566-402b-83aa-7f15b1e674d3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:14.848685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 247/498] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:14.848685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.848685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.848685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.866962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:14.868195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:14.884771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:14.885371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.885643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.885907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.886624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:14.886921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:14.888410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9af93-3f44-4d7d-8120-d9a6dffa5626 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:14.924537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 252/499] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:14.925656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4059b-7375-4944-95df-3c119dea9755 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:14.925938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4059b-7375-4944-95df-3c119dea9755 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:14.926206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4059b-7375-4944-95df-3c119dea9755 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:14.927578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 253/500] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:14.928091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4059b-7375-4944-95df-3c119dea9755 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.936477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 248/501] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:14.937342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:14.980319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.029998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4059b-7375-4944-95df-3c119dea9755 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.032316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.040576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a30d36-ff7c-4548-b294-48149dc7df2d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.067355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.068069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.068406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.068758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.069481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:15.069835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.071536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.074982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.075677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.076058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.076404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.077211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:15.077590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.079093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aae3b-36ba-49fc-bc46-1ac62b21ad68 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.083994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 254/502] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:15.083994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.120871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 249/503] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 22 12:16:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:15.122299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.122722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.123159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.141930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:15.143260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:15.189969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87677-148f-41d2-930b-ea7a176c2f18 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.214641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 250/504] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:15.215485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.235709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.236364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.236648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.236922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.242825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.277800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.313761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.315246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.323666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef115b5f-6d7a-4862-b0bd-fc843e9e0cef None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.360455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.361079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.361355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.361642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.372471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.373895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:15.389298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:15.390188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:15.391037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:15.391037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:15.391037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:15.395068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 251/505] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:15.395899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.423146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 255/506] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:15.423146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.482199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.486812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.502092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298cb86-e950-4e20-918b-643ed13c14fa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.521792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea68b0-6f7e-41aa-8181-da2d550a65a2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.536135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.536734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.537005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.537273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.556258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.556885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.557165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.557435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.567324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:15.572766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:15.573645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:15.574431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 256/507] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:15.575142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.605328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.606838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.671067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f352-a61a-495f-b7df-88f62ed5658a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.683158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.696562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.703275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 252/508] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:15.704226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.705274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.705874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.706148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.706416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.707052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:15.707350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.708752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.719826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 257/509] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:15.720642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.800827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01447ce3-2f76-4940-845d-a18f88eaa771 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.817648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b80e7-296f-4f5b-8086-43490ac38b7a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.833750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.834378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.834655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.834926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.844542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.845976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.850020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:15.850628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:15.850902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:15.851170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:15.861372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:15.861604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:15.862498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:15.863314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:15.863314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:15.863314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:15.863314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 253/510] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:15.863535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:15.863601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:15.880722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:15.881625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:15.882454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:15.882454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:15.882454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:15.882454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 258/511] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:15.882682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:15.898154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.921905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:15.966395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3130c-3816-4798-98e1-69ab2c87819f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:15.983591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039d92-4b0a-4287-8f38-4fd945dbc019 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.000618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.001294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.001580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.001855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.002511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:16.002815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.004214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.011962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 254/512] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:16.012724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.021428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.022058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.022339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.022613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.033724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.035177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:16.049677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:16.050567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:16.051708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:16.051708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:16.051708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:16.051708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 259/513] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:16.051708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.106093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.113017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1d83-df5c-437b-a1bc-3e34b5a2b38e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.141207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.146892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.147524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.147804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.148117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.151064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca3ab-2724-444d-9b6e-b61415e55dd4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.155423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.156897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:16.168314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:16.169373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:16:16.170550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:16.174123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 255/514] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:16.174790 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.185494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294807dc-1bdf-418c-a134-134490247899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.186205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294807dc-1bdf-418c-a134-134490247899 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.186484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294807dc-1bdf-418c-a134-134490247899 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.186753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294807dc-1bdf-418c-a134-134490247899 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.187389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294807dc-1bdf-418c-a134-134490247899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:16.187690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294807dc-1bdf-418c-a134-134490247899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.189066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294807dc-1bdf-418c-a134-134490247899 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.202852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 260/515] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:16.203684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294807dc-1bdf-418c-a134-134490247899 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.277084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7f89-81e5-4c74-9172-a66e07ca8556 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.301321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294807dc-1bdf-418c-a134-134490247899 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.310405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.310949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.311378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.311524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.312213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:16.312523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.313898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.325328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 256/516] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:16.326041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.335198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.335831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.336697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.336973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.340811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.347265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.348730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:16.363684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:16.364773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:16.365825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:16.365825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:16.365825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:16.365825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 261/517] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:16.366060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.368771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.424309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb20da-6207-4f25-a1a6-5700359413b7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.457664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.458258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.458538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.458813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.459441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:16.459742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.461684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.464875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d61ba-caea-4764-a86b-c315e3010572 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.472555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 257/518] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:16.473333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.501883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.502483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.502760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.503026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.503745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:16.504133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.505566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.522680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 262/519] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:16.523446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.546322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.571711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93555a-6bd9-4a01-b158-5098ee5e127d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.580743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.606064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.606690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.606962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.607227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.614009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.615514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.625011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305d463-1f29-42b1-a660-d8fde935e978 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:16.629431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:16.630361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:16.631207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 258/520] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:16.631672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.659363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.660017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.660296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.660566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.661210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.662676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.685365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 263/521] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:16:16 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:16.686170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.739555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3fd8-67e1-442e-acb2-4a6ef95d295e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.777150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.777769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.778044 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.778311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.778962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:16.779265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.780709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.782476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.798580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 259/522] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:16.798580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.807798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892d8cc-c42c-4143-97c8-e193a89e9d00 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.826959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:16.850557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.851198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.851494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.851769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.859596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:16.861089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:16.873938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:16.874802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:16.875629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 264/523] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:16.876135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:16.925108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60192bb-d970-4585-a51e-0a35ac6aaa9b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:16.965914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:16.966711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:16.966980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:16.967250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:16.993966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ba46c-8a64-4076-a060-fa5205c47e94 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.028508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.029118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.029404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.029677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.030374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:17.030679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.032144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.046143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.049997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 265/524] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:17.050925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.060063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.061822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.090361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.159516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3c7a-dae1-466a-8535-7413b9c95c77 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.174450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 260/525] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:17.175903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.200723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.201372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.201675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.201923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.210451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.211998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:17.225120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:17.226284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 12:16:17.227393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:17.230823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 266/526] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:17.231640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.289192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.299228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7eb9b-62fd-43b5-adfb-3f5697cc2da7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.338764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.345594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.345727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09b4e1-e903-4ad3-a133-6da13ee8da52 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.346427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.346843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.347257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.348634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:17.349028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.351246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.374587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 261/527] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:17.375432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.387534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.388175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.388458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.388731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.389462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=d671292a536e4a61931f1127f63c2883) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:17.389770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.391210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.396822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 267/528] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/role_assignments?user.id=d671292a536e4a61931f1127f63c2883&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:17.397603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.491923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775a0d5-01a1-4a6a-a1b4-aabef24113b7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.529789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.530754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.531184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.531597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.543087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.544824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.544940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec5cf1-b73f-42ac-86dc-48899bd30b3f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:17.561636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:17.562621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:17.563457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:17.563457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:17.563457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:17.565617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 262/529] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:17.566696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.576796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.590003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.590735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.591089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.591433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.592887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:17.593273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.595372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.625021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 268/530] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:17.627020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.651147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.700990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c8011-b053-48e3-bcc4-590336f7ce0a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.743859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.744918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.745200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.745474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.746482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=11272670de874c5094fdfb776b4a8b75) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:17.746792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.748987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.757697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146304df-fe95-4c6e-a236-fb3ff66ce33d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:17.760145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 263/531] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/role_assignments?user.id=11272670de874c5094fdfb776b4a8b75&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:17.761063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.835694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:17.837316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:17.837592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:17.839676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:17.840419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:17.840724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:17.845401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:17.865031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 269/532] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:17.871840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:17.925475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:17.984403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa389e1-727b-4c82-be59-ac7769fe23d5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:18.020724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:18.024793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:18.025666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:18.026173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:18.026646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:18.057862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07dfb6-169d-4970-b831-cd8de288732a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:18.132193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:18.133274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:18.133781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:18.135501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:18.150430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:18.152973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:18.166881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:18.168695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:18.176242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:18.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:18.177918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:18.180859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 270/533] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:18.188919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:18.292276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:18.346606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 264/534] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:18.353645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:18.401633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffcede-60ad-424d-99ed-632f5820e9b4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:18.465570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a353175-fd49-4d71-8d8b-05cecd8a4220 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:18.503423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:18.504086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:18.505602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:18.505885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:18.510805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:18.511416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:18.512055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:18.512327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:18.513020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:18.513323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:18.514745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:18.527923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:18.531828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:18.533423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:18.545959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 271/535] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:18.546879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:18.564876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:18.565796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:18.566623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:18.566623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:18.566623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:18.567987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 265/536] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:18.572678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:18.620291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:18.730740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef536a-ee0f-4b42-a8ce-c6ff3159a6d3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:18.756807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d8cc0-edc2-477c-b557-4bff8f29ebfb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:18.792343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:18.792958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:18.793233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:18.793502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:18.794227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=fc7ee82e55b8416dbf41dd368cc435d9) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:18.794536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:18.796015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:18.802308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 272/537] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:18 2022] GET /identity/v3/role_assignments?user.id=fc7ee82e55b8416dbf41dd368cc435d9&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:18.850272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:18.850907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:18.851191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:18.851568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:18.852881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:18.853187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:18.854590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b482fde-c01d-4227-93d8-b81256aee269 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:18.878026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 266/538] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:18.883454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:18.988148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:19.025644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b04d5-323a-470c-b819-6c153bd274a0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.025911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b04d5-323a-470c-b819-6c153bd274a0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.026188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b04d5-323a-470c-b819-6c153bd274a0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.028032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 267/539] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:19.033022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.033309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.033588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.046231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c50f3-e446-4bd5-9a85-1ff2fd0ff27e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:19.055023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:19.056405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:19.082407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:19.083041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.083368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.083645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.099962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:19.103603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:19.131112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:19.132009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:19.132845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 273/540] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:19.141415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:19.191041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 268/541] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:19.306222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f906e7-9cd9-4e35-b3ef-72bf6ef40fac None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:19.341677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:19.354396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:19.355011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.355289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.355560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.356283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:19.356587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:19.358003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:19.378483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 274/542] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:19.384843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:19.414060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:19.528250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:19.545170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9718c-3539-484d-9731-2f3162a47200 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:19.575621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:19.576173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.576693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.577159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.578097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=f34655a63e6441f995031cdf8770741e) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:19.578577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:19.580200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:19.586881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 269/543] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:19 2022] GET /identity/v3/role_assignments?user.id=f34655a63e6441f995031cdf8770741e&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:19.720050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9241653-9aef-477a-ac5a-0e714286d5b6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:19.756435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cd02b-8e35-4bbd-940d-9fefcbf12130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:19.757116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd02b-8e35-4bbd-940d-9fefcbf12130 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.757398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd02b-8e35-4bbd-940d-9fefcbf12130 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.757675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd02b-8e35-4bbd-940d-9fefcbf12130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.771177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cd02b-8e35-4bbd-940d-9fefcbf12130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-088cd02b-8e35-4bbd-940d-9fefcbf12130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:19.777057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:19.778031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:19.778803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 275/544] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:19.784504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:19.913994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:19.930114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ad2c-bd97-4882-8c6a-6e4d998ad5af None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.930618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ad2c-bd97-4882-8c6a-6e4d998ad5af None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.931041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ad2c-bd97-4882-8c6a-6e4d998ad5af None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.940050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 276/545] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:19.943356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5059b-dfa6-4725-9994-cfb53803f89c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:19.946548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.946825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.947087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.986536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:19.987151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:19.987424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:19.987690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:19.988379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:19.988679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:19.990326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:19.994315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:19.995528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:20.009732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 270/546] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:20.012426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:20.076299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:20.135350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 277/547] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:20.172028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfacc6d-6bed-43f6-9480-06eef8d7f8a1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:20.212391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:20.213027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.213302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.213571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.227491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:20.229032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:20.232266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-00cb9139-94bf-4d1f-976a-55bef821ee8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:20.251453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:20.252425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:20.253246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:20.253246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:20.253246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:20.253246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 271/548] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:20.260513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:20.387497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774bb66-736b-4056-a688-e2b47e026111 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:20.436627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:20.437151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.437425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.437692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.438398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:20.438699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:20.440092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:20.450099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573e47-d0e9-4a75-a2e5-e5c86561435e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.450571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573e47-d0e9-4a75-a2e5-e5c86561435e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.450644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573e47-d0e9-4a75-a2e5-e5c86561435e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.452035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 272/549] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:20.458578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.459129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.459500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.459610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 278/550] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:20.464877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:20.479193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:20.480531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:20.507245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:20.562572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 273/551] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:20.565190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:20.628676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed326e-b147-4f96-8492-3eb41af14fcb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:20.691729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:20.692709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.693203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.693666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.704738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:20.706497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:20.725468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:20.726571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:20.728031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:20.733936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 279/552] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:20.737698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538023a-6c61-4546-a681-cfca0e44cc96 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:20.739434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:20.775277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:20.801757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:20.808173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.808492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.808783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.837340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:20.843690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:20.844817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:20.845664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 274/553] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:20.850584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:20.897622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:20.912594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549847-a995-4cb1-ada5-88495c47ce59 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:20.959455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:20.960044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:20.960730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:20.961002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:20.962520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:20.962823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:20.964951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:20.970045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46723ab8-545f-4ea0-80a0-52fa16d55fab None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:20.988343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 280/554] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:20.989548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.010295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.010903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.011178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.011450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.012141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:21.012445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.013804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.027174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 275/555] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:21.028055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.072053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.114081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fddefe-af00-4e3a-b218-0f870378479f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.130344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00816450-69ea-41bd-b0bf-8650c29ba1f4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.152010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.152673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.152953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.153222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.165803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.166510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.166850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.167185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.167338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:21.172622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:21.174505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:21.176296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:21.180374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 281/556] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:21.180374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.195101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.255992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.257676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.297584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b0ed-66a1-471e-b7bf-e3d899f7ded2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.299890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.336214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.336852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.337127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.337393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.347792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.349308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.361215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 276/557] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:21.362235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5f04ab83-3dd8-4f89-b225-00002c2a87fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:21.365309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:21.366199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:21.367054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:21.367054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:21.367054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:21.367054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 282/558] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:21.368118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8077-4127-4582-8204-eb3a82d79dab None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.368641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8077-4127-4582-8204-eb3a82d79dab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.368926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd8077-4127-4582-8204-eb3a82d79dab None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.370270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 283/559] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:21.370820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd8077-4127-4582-8204-eb3a82d79dab None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.434744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.468179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed848fb-68ec-4722-a7cf-3cc8fe01896c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.474585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd8077-4127-4582-8204-eb3a82d79dab None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.506248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.506775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.507100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.507316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.508040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:21.508392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.508996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.509618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.509728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e9c4f-bddf-473e-a4ac-c9a73a939c9e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.509882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.510141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.523201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 277/560] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:21.523201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.523201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.523479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.523613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.523690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.529663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:21.539156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:21.540783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:21.541630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:21.541630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:21.541630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:21.541813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:21.542245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:21.544166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 284/561] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:21.546158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.611583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 278/562] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:21.616780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.661887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d1739-6140-43d4-b4be-d2ac407e0691 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.680938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.709063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.710452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.710959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.712223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.712891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:21.713221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.714573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.729856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 285/563] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:21.730683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.749117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603214f-f41e-4916-8af2-4d77ebf4f6d5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.796256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.797238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.797728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.798437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.801278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.814227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.816449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:21.831735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:21.832705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:21.833564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:21.833564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:21.833564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:21.833564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 279/564] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:21.834206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.843572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb2cdf-dafb-41a5-b5e7-9710a0bd116a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.888047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.889035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.889925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.890396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.891494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:21.892160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.894319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:21.909595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 286/565] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:21.910697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:21.940601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5d979-4004-4ff0-ae86-7a25e8a5080f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:21.949772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:21.978656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:21.979288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:21.979558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:21.979835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:21.987586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:21.989118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:22.001776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:22.002840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:22.003751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 280/566] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:22.004395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.031193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e421c5e-5783-479a-882c-ae923186ca62 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.056538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.066517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.067129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.067403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.067678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.068348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.068650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.070011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.082783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 287/567] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.083583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.118273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00bd69-57ef-4f0b-8088-699c6b423a31 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.151343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.152049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.152325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.152625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.162352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:22.167534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:22.168591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:22.169417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 281/568] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:22.170661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.177368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.186463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a96ee-01d7-4e89-9045-8c994052b47f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.221106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.221731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.222006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.222271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.228880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.230320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:22.241305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:22.242353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 288/569] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:22.248694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.271155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37744e2-5f1a-44a3-9f8a-78f4a8b0cf47 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.278237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.303655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.304279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.304552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.304844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.305549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.305848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.307315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6da92b-6266-44a0-9fd2-503c7e105ae6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.323859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 282/570] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.325039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7939dd7-cead-4ada-a0c2-bc990939db2d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.325321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7939dd7-cead-4ada-a0c2-bc990939db2d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.325588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7939dd7-cead-4ada-a0c2-bc990939db2d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.326769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 283/571] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:22.327455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7939dd7-cead-4ada-a0c2-bc990939db2d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.348651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a87c7-3cc7-4e3f-97f6-93504981245e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.382556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.383719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.384024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.384294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.391131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.392601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:22.403876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:22.404896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 289/572] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:22.406201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.422371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.429220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7939dd7-cead-4ada-a0c2-bc990939db2d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.465074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.465683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.465965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.466496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.466897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.467203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.468596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.476341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 284/573] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.477154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.503887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.511342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087cdd2-1f8c-41f0-9c37-c5fe64294509 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.543648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.544281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.544561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.544829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.545514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.545817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.547229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1051-685a-40e1-b92b-e930bad53856 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.559329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 290/574] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.560439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.560739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.561009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.578126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:22.579301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:22.581063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c114-1b16-4d85-8f30-2a9f6d70a327 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.613171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.613798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.614079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.614357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.626255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.627676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:22.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:22.642668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:22.644014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:22.644014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:22.644014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:22.644014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 285/575] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:22.644014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.652062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 291/576] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:22.653212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.656730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.723921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.748529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206196bb-2fca-4cd1-9ca2-c7adf347d86e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.758617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89c845-bf31-4581-9298-98e4ad70d443 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.782411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.783018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.783295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.783564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.784307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.784610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.786016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.794323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.795141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.795589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.795856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.803267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 286/577] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.804270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.810726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.812157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:22.827133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:22.828120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:22.828988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:22.828988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:22.828988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:22.828988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 292/578] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:22.828988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.887550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.915369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299d179-3dcb-442b-b1ff-dc16acca7249 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.931585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269910-7278-46fe-9944-edf7387b68f4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:22.949960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.950568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.950848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.951119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.951834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=c1605f3029484ea2a5e98a1b10caf075) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.952171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.953593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.956337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:22.969182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 287/579] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/role_assignments?user.id=c1605f3029484ea2a5e98a1b10caf075&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.969182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:22.969474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:22.969474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:22.969474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:22.969474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:22.969806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:22.969806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:22.969806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:22.981557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 293/580] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:22.982438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.087411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef350e-ffcc-423d-a3c0-249fd3618739 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.108388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f99f6f-59fc-4035-814c-063161ebaa35 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.127301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.134487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.135134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.135418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.135696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.148055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.149548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.150901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.151517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.151799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.152192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.152843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:23.153148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.154497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:23.165453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:23.166454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:23.167330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:23.167330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:23.167330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:23.167498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 294/581] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:23.167498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.169104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 288/582] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:23.170057 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.228334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.285636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea7e3-5ad7-4947-acff-0a88afd564c1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.288834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1809-e1f0-49fb-9996-6f4ec37121b4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.326652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.327291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.327573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.327850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.328106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.329095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.329542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.329965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.334856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.336339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.341014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:23.346466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:23.347524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:23.348572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:23.349187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:23.349968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 289/583] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:23.350811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.352554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 295/584] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:23.353455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.392315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.458809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9273b5-ddd2-46ce-bebc-8a9ad14484ad None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.459042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2f39-79bf-42de-8785-a3635ecb77b8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.471634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.494929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.495631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.495910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.496208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.496905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:23.497256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.497874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.498503 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.498600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.498784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.499059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.507693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.509647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.515439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 296/585] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:23.515439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:23.526662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:23.527580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 290/586] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:23.533340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.620804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.627552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b381b4-4f70-42fb-8479-f98cb61cf709 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.639676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2ed6b-f784-4b5b-9d6c-283855ede13a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.662102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.662720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.662992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.663259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.663968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:23.664805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.666325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.675084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.675666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.675961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.676265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.676955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:23.677259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.678431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 297/587] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:23.678610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.681268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.689358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 291/588] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:23.690172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.724805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.791884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe63f9-bf42-4605-a8d7-363022b17296 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.803147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b758483-4a2f-42da-b631-fb290924bb28 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.826468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.827098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.827387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.827663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.828453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:23.828767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.830248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.845572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:23.846219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:23.846498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:23.846771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:23.851280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 292/589] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:23.852968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.857610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:23.859058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:23.870696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:23.871800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:23.872721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 298/590] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:23.873208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:23.895361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.959692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:23.968997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079dfbf-f1cf-4209-b3e7-5b4c3532f88f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:23.984162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdb53b-c8fd-41c6-8671-67f65cdd4728 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.005356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.006124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.006295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.006569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/d671292a536e4a61931f1127f63c2883/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.021030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.021299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=d671292a536e4a61931f1127f63c2883, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.021682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.021959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.022232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.024238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.033583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.034999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.048044 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 293/591] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:23 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/d671292a536e4a61931f1127f63c2883/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:24.048044 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:24.060488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:24.061546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:24.062431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:24.062431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:24.062431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:24.062956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 299/592] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:24.063811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.146901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:24.188657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef3d1-619c-4a01-a7f9-c16ccd2a389b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.191779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83b191-07d0-4022-a066-0be3174f2ad9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.230468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.231194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.231543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.232626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.232751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:24.233094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.235065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.250894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 300/593] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:24.251587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.259800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.260507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.260787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.261058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.276755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.278852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.281250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:24.301133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:24.302111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:24.303002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:24.303002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:24.303002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:24.303002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 294/594] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:24.303665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.365588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314761-7270-45b6-b45c-f7f0dc1b9edd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.394581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:24.404438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.405321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.405862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.406339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.407224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:24.407716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.409372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.422030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 301/595] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:24.423157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.440971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978a96-4104-4e4f-a6d1-7e4cc8c33da4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.485414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.486060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.486345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.486621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/11272670de874c5094fdfb776b4a8b75/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.505028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=11272670de874c5094fdfb776b4a8b75, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.506889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.526581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 295/596] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:24 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/11272670de874c5094fdfb776b4a8b75/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:24.527700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.533170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb51dd-34e8-4c57-9836-55c4dfacfa54 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.574699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.575886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.576467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.576946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.577835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:24.578388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.580266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.591009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:24.605633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 302/597] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:24.611217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.669762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddecc-3d2f-43b2-be2b-50fc64ee985f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.712359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:24.754852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.755637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.755890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.756203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.767533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.769148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.774540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c384d92-9c45-4a1f-8b24-5a73023d9aba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:24.788360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:24.789638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 12:16:24.790551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:24.794450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 296/598] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:24.795656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.821870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.823457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.823947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.824413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.832100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.833994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:24.846779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:24.847691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:24.849408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:24.851152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 303/599] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:24.860376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:24.915468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014fad-7319-418c-b5a5-d1d60d7c1463 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.918123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:24.955654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:24.956662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:24.957151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:24.957635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:24.958611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:24.959136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:24.961174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:24.988792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e23d-dd39-437a-a860-4de6f52538c4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:24.996344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 297/600] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:25.009827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:25.011133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.032423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:25.033051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.033337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.033614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.034387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:25.034702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:25.037307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:25.071392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 304/601] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:25.089492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.202378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9904-f373-4686-b74e-72c9f6bfdd3c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:25.227395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338b350-5f88-4d84-aa8f-f9e80965965c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:25.239742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:25.240491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.240763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.241398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.253399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:25.255157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:25.263518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:25.264209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.264487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.264758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/fc7ee82e55b8416dbf41dd368cc435d9/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-fe974198-8a4e-48d2-9760-87a8163c07ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:25.271262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:25.272410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:25.273433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:25.273433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:25.273433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:25.275095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 298/602] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:25.275328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1e14-1695-4caa-b608-c05537a5d322 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.275616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1e14-1695-4caa-b608-c05537a5d322 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.276034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1e14-1695-4caa-b608-c05537a5d322 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.283280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 299/603] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:25.285254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.285540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.285814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.286120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=fc7ee82e55b8416dbf41dd368cc435d9, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:25.287671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:25.307996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 305/604] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:25 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/fc7ee82e55b8416dbf41dd368cc435d9/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:16:25.309041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.313364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:25.314929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:25.331162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:25.340333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:25.414762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 300/605] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:25.435678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4d9b4-ca1e-433e-8672-fc8212059afb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:25.472908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:25.473690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.474070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.474441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.475247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:25.475650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:25.477816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:25.489921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 306/606] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:25.496720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.640144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ec506-fbc7-43b2-9d4d-f1605159fc9e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:25.676151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:25.676832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.677115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.677387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.684302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:25.685743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:25.697659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:25.698543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:25.699411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 301/607] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:25.704416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.748884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.760342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:25.813500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:25.842301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544954d-9715-4e30-81a8-c7f9f1943764 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:25.891893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:25.892531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:25.892809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:25.893083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:25.893774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:25.894090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:25.895501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:25.925988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 307/608] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:25.931816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:25.969393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e57d7e-4456-4626-94fd-dd51312003c6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:26.041828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:26.042865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.043351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.043824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.065468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:26.072281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:26.073288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:26.074125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:26.084953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 302/609] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:26.089057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc9e49-c348-42c5-b631-417525c8fe3a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:26.090953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:26.130488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:26.131181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.131453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.131726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/f34655a63e6441f995031cdf8770741e/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.152486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:26.157130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=f34655a63e6441f995031cdf8770741e, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:26.158600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:26.185686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 308/610] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:25 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/f34655a63e6441f995031cdf8770741e/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:26.210715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:26.271123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db4fc6-a8ab-4289-8188-080afaa9bc9b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:26.322358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:26.322908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.323217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.323472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.324188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:26.324497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:26.325934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:26.339609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 303/611] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:26.340910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:26.465071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b37f-a205-4ed0-b571-05b43028f3f8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:26.500103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:26.500788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.501066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.501331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.512123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:26.513565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:26.529186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:26.530146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:26.531042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:26.531042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:26.531042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:26.531042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 309/612] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:26.535827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:26.660000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799e33c-6937-4ddf-973f-c930a2aae9a3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:26.696583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:26.704929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:26.705545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.705821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.706095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.706730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:26.707029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:26.708429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10251d-1a40-4e41-b1a5-e80be4be6fb1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:26.731214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 304/613] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:26.736423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:26.786720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:26.794788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224438-981c-4627-99b2-60a8dac82aef None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.795068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224438-981c-4627-99b2-60a8dac82aef None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.795342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224438-981c-4627-99b2-60a8dac82aef None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.796860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 305/614] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:26.807067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.807342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.807616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.830294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:26.831475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:26.896330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab865a-e519-4437-bcc0-1fe041ff6a19 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:26.956365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 306/615] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:26.957451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:26.958091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:26.958365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:26.958633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:26.967085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:26.968574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:26.980773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:26.981746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:26.982694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 310/616] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:26.989022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:27.119456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7362c3a-8319-4705-aa95-7128433c45c9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:27.166720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:27.221031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:27.221583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:27.221931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:27.222211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:27.222962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:27.223470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:27.224986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:27.254298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 307/617] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 22 12:16:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:27.263390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:27.319366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:27.397391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eaccd-ec20-4777-9dae-c1b29170a87b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:27.400372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:27.501567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:27.502604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:27.502882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:27.503409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:27.522915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:27.524980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:27.531695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83041f5-2fcb-48b4-ac4b-78a807321bb9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-15a8bef7-6660-4a78-9a21-0abee6020e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:27.554821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:27.555875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:27.556832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:27.556832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:27.556832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:27.563189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 311/618] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:27.564544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87308-adb8-4ab5-a0ec-a7446da8823a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:27.567974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87308-adb8-4ab5-a0ec-a7446da8823a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:27.567974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa87308-adb8-4ab5-a0ec-a7446da8823a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:27.567974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 312/619] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:27.567974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87308-adb8-4ab5-a0ec-a7446da8823a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:27.609852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19089d-126d-464d-8ea6-66d142fb351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:27.610527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19089d-126d-464d-8ea6-66d142fb351a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:27.615956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19089d-126d-464d-8ea6-66d142fb351a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:27.615956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19089d-126d-464d-8ea6-66d142fb351a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:27.628556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19089d-126d-464d-8ea6-66d142fb351a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-be19089d-126d-464d-8ea6-66d142fb351a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:27.633898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:27.634998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:27.635823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:27.641849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 308/620] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:27.648216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:27.648529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:27.648805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:27.686430 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:27.687629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:27.736869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:27.749862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa87308-adb8-4ab5-a0ec-a7446da8823a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:27.788589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 309/621] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:27.789900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:27.790488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:27.791391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:27.791892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:27.792442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:27.793358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:27.793899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:27.795473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:27.809334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 313/622] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:27.814696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:27.859616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:27.981046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2d03-2105-44f7-8942-ed76c17e7a7c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:27.983055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f15c44-b88c-451f-bf0c-12449f7e7ced None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.024722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.025363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.025647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.025758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.025930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.026265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.026544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.026816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.027483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:28.027785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.029184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f160aa-9cec-4653-a14c-6f74a1805ec0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.033618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.035884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.037664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 310/623] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:28.038940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6961c7-5f40-4a3b-bbfb-0296b0e4ba28 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.039690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6961c7-5f40-4a3b-bbfb-0296b0e4ba28 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.039986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6961c7-5f40-4a3b-bbfb-0296b0e4ba28 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.045326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 311/624] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:28.046116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6961c7-5f40-4a3b-bbfb-0296b0e4ba28 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-81f0a785-6008-4a2c-a74c-6856b3be0789 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:28.051145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:28.052121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:28.052980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 314/625] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:28.054517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.054517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.054517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.079466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.084150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:28.086581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:28.168004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6961c7-5f40-4a3b-bbfb-0296b0e4ba28 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.168315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 315/626] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:28.169317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.171698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.211966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.213089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.213523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.214193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.229445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.231582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:28.251945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:28.253056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:28.254124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:28.254124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:28.254124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:28.256212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 312/627] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:28.257601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.298361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9563c5-70f4-42b7-bfc0-f276439a62fc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.334119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.334895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.335284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.335691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.337136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:28.337553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.339081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.355957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 316/628] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:28.355957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.366026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.389844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd28f4-96ab-4d60-8a27-303a0c5f5cdc None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.421683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.425657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.427604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.427604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.427604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.438384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:28.443905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:28.444828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:28.445752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:28.449385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 313/629] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:28.450379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.465385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc56b62-c4d5-4def-ad5d-016261ca4107 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.504805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.505417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.505698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.505972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.506616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:28.506918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.508354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.525317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 317/630] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:28.525317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.569160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998b207-070c-4c8e-8e80-6de01c0787db None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.604789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.605445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.605717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.605984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/c1605f3029484ea2a5e98a1b10caf075/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.615582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.625275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=c1605f3029484ea2a5e98a1b10caf075, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.626711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.629311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d59fca-cfb0-4bb4-a649-9e59c3ab467a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.639175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 314/631] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:28 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/c1605f3029484ea2a5e98a1b10caf075/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:28.640022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.668509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.686544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.688208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.688734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.689228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.690589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:28.691122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.693584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.712270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 318/632] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:28.712270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.793249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c247-d0fb-4513-ad1c-b54c5d85074d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.832522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e0b25-ed55-43b1-8357-1f8ccd789afb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:28.846065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.846994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.847277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.847611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.861209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:28.866224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:28.867387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:28.868359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 315/633] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:28.869329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.882007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:28.882654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:28.883455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:28.883727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:28.892967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:28.894702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:28.907818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:28.908843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:28.909812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 319/634] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:28.910422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:28.940366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:28.973343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.010372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80b105-8f67-4fa6-90a7-f9eba326f31a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.046297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.046930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.047206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.047502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.047796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab0de8-c807-4d48-bdf5-ea93afad3937 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.059434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.060915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:29.075800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:29.076957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:29.078041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:29.078041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:29.078041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:29.081402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 316/635] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:29.082198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.090740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.092144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.092618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.093058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.094353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:29.094844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.096975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af12f0-0c2d-489a-b0b1-970c238ab0da None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.107922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 320/636] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:29.118404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf9b0-a6d7-4556-a845-b52fb7929cf9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.119278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf9b0-a6d7-4556-a845-b52fb7929cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.119747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf9b0-a6d7-4556-a845-b52fb7929cf9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.121387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 321/637] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:29.122304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf9b0-a6d7-4556-a845-b52fb7929cf9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.191819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.203143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab78e-e067-46bf-8077-4589b91701e7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.230206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf9b0-a6d7-4556-a845-b52fb7929cf9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.238437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.239063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.239747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.240146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.240434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.241162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:29.241420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.243498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.262275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 317/638] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:29.263395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.272094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.272724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.273007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.273284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.274736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:29.275704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.277614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2ae2-c98c-45ff-a323-cb0e6e37813b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.290401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 322/639] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:29.291742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e1491-a26f-456b-8210-046c90e8158c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.292056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e1491-a26f-456b-8210-046c90e8158c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.292334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e1491-a26f-456b-8210-046c90e8158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.312690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-482e1491-a26f-456b-8210-046c90e8158c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:29.313892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-482e1491-a26f-456b-8210-046c90e8158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:29.375607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2556e9-7401-4b29-9869-eea4afa1656e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.391961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 323/640] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:29.391961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e1491-a26f-456b-8210-046c90e8158c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.432801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.433991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.434632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.435013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.450007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.452227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:29.473280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:29.474281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:29.475139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:29.475139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:29.475139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:29.476426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 318/641] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:29.479953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.492241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.498186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.499255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e1491-a26f-456b-8210-046c90e8158c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.536448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192c609-2631-4b67-8143-097abf980334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.537061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192c609-2631-4b67-8143-097abf980334 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.537337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192c609-2631-4b67-8143-097abf980334 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.537611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192c609-2631-4b67-8143-097abf980334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.613761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192c609-2631-4b67-8143-097abf980334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.615286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192c609-2631-4b67-8143-097abf980334 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.620902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65a87-b61e-474e-ae2e-d207f478e906 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.667791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.669174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.669609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.670329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.679304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.680813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:29.691813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:29.692869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 319/642] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:29.699118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.713479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.720701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 324/643] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:29.725687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192c609-2631-4b67-8143-097abf980334 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.771404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.805725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81737993-c2fe-4c6a-bac3-0b3ef4e75f66 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.830395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192c609-2631-4b67-8143-097abf980334 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.841786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.842418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.842674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.843033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.843709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:29.844041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:29.845797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:29.859980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 320/644] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:29.859980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.870706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:29.871341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:29.871618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:29.871892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:29.882093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:29.887492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:29.888462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 325/645] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:29.889454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:29.947737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:29.969481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5e19f-7257-459a-bf57-b0becd722943 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.995351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285eb0a-b902-422f-9a40-310b146e67cb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:29.999697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.006666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.007276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.007551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.007838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.009330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:30.009636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.011172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.033668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.033875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 321/646] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:30.033971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.034070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.034154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.034154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.043092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.044575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:30.060300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:30.061849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:30.062965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:30.062965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:30.062965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:30.065800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 326/647] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:30.066596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.139468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdef76d-8144-4a9e-8fa7-f7043f381eed None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.174451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d420f-2a1f-4c91-9a86-540f5ae3459c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.176262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.177635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.177917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.178190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.184312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.186148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.187746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:30.199819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:30.200816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 322/648] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:30.202269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.223790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.224795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.225234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.225665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.226472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:30.227486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.229149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.243569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 327/649] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:30.244912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.251583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.302748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903a5ad-cf5f-4af4-b3a1-107519f81e37 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.336748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.337356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.337635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.337906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.351212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2684de-03c6-4558-897e-23d58c283d25 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.387660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.388305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.388587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.388862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.389506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:30.389811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.391179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.407431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 328/650] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:30.407431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.411794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.413294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.441172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.464506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.516707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f84ad-17a3-4958-83b8-d2ff521fbcb5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.519965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 323/651] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:30.520727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.559839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.560904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.561182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.561450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.562528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:30.562835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.564928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.591442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 329/652] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:30.591442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.620354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c151f-e9d7-4d62-be4c-5cded3950c75 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.655609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.656287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.656539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.656811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.668388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.669836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.678078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:30.684936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:30.686054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:30.687248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:30.687248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:30.687248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:30.689174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.689291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 324/653] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:30.690048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.704532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e532-21ea-4028-9f90-0db30f718506 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.746614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.747295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.747573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.747842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.755799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.757548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:30.769915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:30.770871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:30.771766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 330/654] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:30.772773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.806208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a272aba-4470-4f0f-bc16-365aad6476ce None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.840984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.841953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.842515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.843007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.856408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.857855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:30.872255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:30.873233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:30.874114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:30.874114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:30.874114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:30.874114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 325/655] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:30.874114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:30.879958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659686-6fb6-46f6-8292-d60192cd95a6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.913633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77753ef-087e-46de-8beb-cf85a91ca264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:30.914802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77753ef-087e-46de-8beb-cf85a91ca264 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:30.915075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77753ef-087e-46de-8beb-cf85a91ca264 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:30.915343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77753ef-087e-46de-8beb-cf85a91ca264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:30.931436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.932267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:30.978443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82259c-c961-407a-8496-7c7b09031baa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:30.982038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77753ef-087e-46de-8beb-cf85a91ca264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:30.983542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77753ef-087e-46de-8beb-cf85a91ca264 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.011217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.011763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.012069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.012349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.012984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.013287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.014635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.026638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 326/656] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.027260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.082547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 331/657] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:31.084518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15cfa-6bad-4380-ab49-020a651cd325 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.084800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15cfa-6bad-4380-ab49-020a651cd325 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.085065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15cfa-6bad-4380-ab49-020a651cd325 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.086851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 332/658] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:31.087726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15cfa-6bad-4380-ab49-020a651cd325 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.127824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0a19-0c59-468a-9d28-a9637d59fb22 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.137980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.141190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.165826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.166888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.167266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.167544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.168277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.168586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.170050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.181709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 327/659] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.182506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.196197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15cfa-6bad-4380-ab49-020a651cd325 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.230940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.231533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.231808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.232108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.232737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.233030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.234389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.245485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 333/660] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.246257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.287221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125dc7-cfc3-4e92-8121-112241fc0b37 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.319092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.319722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.320029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.320303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.330703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.332232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-48dca20a-2de5-44ce-8311-be941fad0460 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:31.343802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:31.344949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 328/661] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:31.346112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.346915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.346915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.353723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b595a-0089-40ea-a34d-f9ca3ce4ee40 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.362547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.363588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:31.364787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:31.388555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.389382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.389664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.389939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.390945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.400659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.402113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:31.415905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:31.416928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:31.417847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:31.417847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:31.417847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:31.417847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 334/662] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:31.418068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.436006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 329/663] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:31.436940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.531516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd2094-5c0e-4558-b124-79de32427f7d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.537131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65589dd5-f396-4636-b4bd-25190b71929b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.564599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.565131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.565420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.565694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.566417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=d671292a536e4a61931f1127f63c2883) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.566732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.568164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.572423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.573051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.573328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.573598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.576201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 335/664] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/role_assignments?user.id=d671292a536e4a61931f1127f63c2883&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.577068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.590086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.592228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:31.605476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:31.606452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:31.607365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:31.611571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 330/665] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:31.612649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.614210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.644793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.709987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8263f9-1638-4163-b4bd-709a6ba568a6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.744973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be871af5-bb49-48ca-8538-47fc9b405400 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.753713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.754388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.754631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.754903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.755649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.755988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.757458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.776958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 336/666] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.777814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.789838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.790454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.791046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.791320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.792298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.792488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.793827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.807703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 331/667] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.808633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.876018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.900117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d232d3-77da-4dcc-ba37-157e606a3cde None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.905163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:31.923740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03860f-712d-48af-9c34-d4ca4b03f983 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:31.942916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673b26-6914-445d-90da-b726f82606bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.943526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673b26-6914-445d-90da-b726f82606bc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.943801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673b26-6914-445d-90da-b726f82606bc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.944515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673b26-6914-445d-90da-b726f82606bc None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.944905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673b26-6914-445d-90da-b726f82606bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:31.945209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673b26-6914-445d-90da-b726f82606bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:31.946804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673b26-6914-445d-90da-b726f82606bc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:31.958454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:31.963909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:31.963909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:31.964146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 337/668] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:31.964257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:31.964332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673b26-6914-445d-90da-b726f82606bc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:31.974038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:31.979852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:31.980809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:31.981648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 332/669] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:31.982765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.071510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673b26-6914-445d-90da-b726f82606bc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.087029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4db8-15d5-41b8-9def-bf89d139ed23 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.108626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.109794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.110229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.110494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.123618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.123901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.124688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.124848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.125096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.132239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.133648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:32.144787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:32.145689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:32.146572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 333/670] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:32.147336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.150217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.191804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.193488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.261697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67867d-52fa-415e-818a-597d5bf8bc1d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.297737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.298494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.298895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.299275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.300134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=11272670de874c5094fdfb776b4a8b75) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:32.300543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.302064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.307680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 338/671] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:32.307680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.313100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 334/672] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/role_assignments?user.id=11272670de874c5094fdfb776b4a8b75&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:32.322425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.355633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.418779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.422860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b18faa-c2aa-4eff-a649-d6b74cebb852 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.464991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f356-cbb6-434c-9130-3f0036cbfe17 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.471116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.471750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.472061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.472335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.473017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:32.473318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.474712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.485034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 339/673] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:32.485907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.519620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.520736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.520736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.521128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.521921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:32.522347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.524801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.540924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 335/674] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:32.542129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.618954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4f6b-039f-437c-b5cf-b645ca9ef501 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.623017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.658249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.659219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.659641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.660086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.668449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4166143-0095-47b3-9258-7a039f656a78 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.672354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.673953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:32.689803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:32.690972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:32.691964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:32.691964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:32.691964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:32.693768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 340/675] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:32.694773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.695878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.705396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.706816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.706816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.707279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.718428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.720010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:32.738516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:32.739696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:32.740862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:32.740862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:32.740862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:32.747656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 336/676] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:32.748576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.807687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58fd5f-39de-46bc-9c22-c73e83fad9ef None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.844682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.845764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.846252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.846655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.847590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=fc7ee82e55b8416dbf41dd368cc435d9) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:32.848312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.849921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.858404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 341/677] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/role_assignments?user.id=fc7ee82e55b8416dbf41dd368cc435d9&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:32.859659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:32.861679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360aef-6031-4709-bead-70f176f5a13d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:32.888318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:32.904218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:32.905350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:32.905861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:32.906362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:32.907220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:32.907729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:32.909423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:32.924440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 337/678] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:32.929749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:33.007307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:33.048921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a768f8-c5ef-4a3a-b726-a4edf41c9131 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.101357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.103097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.103382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.103656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.104619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:33.104926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.107139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:33.115102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508e57b-750e-47f1-b971-eeea7e549ae1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.123372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 342/679] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:33.130687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:33.157785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.158427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.158705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.158985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.168429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.170829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:33.190985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:33.192093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:33.193119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:33.198482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 338/680] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:33.206050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:33.236959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:33.274208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbce7a-9e5e-42a1-b536-2a7436af38fe None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.347297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.348166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.348609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.348885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.369011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.370472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:33.371023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:33.382786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:33.384634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:33.385554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:33.386086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44187aad-0694-4159-bddb-fccc3cc89462 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.390860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 343/681] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:33.390860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:33.440564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.441230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.441441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.441715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.442398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:33.442702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.444152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:33.468433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 339/682] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:33.477035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:33.576222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de799729-fa3d-4ded-ae7c-0903a55411c6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.639626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.640311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.640591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.640861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.641592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc798dc-3f8a-4506-844d-96ba13f41f22 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.641712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:33.641891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.643317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:33.652791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:33.661181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 344/683] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 22 12:16:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:33.666794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:33.719488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.720039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.720318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.720585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.721300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=f34655a63e6441f995031cdf8770741e) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:33.721603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.723000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:33.738578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 340/684] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:33 2022] GET /identity/v3/role_assignments?user.id=f34655a63e6441f995031cdf8770741e&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:33.785317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a8940-5778-4617-8ee2-3c9059163a7d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:33.822669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3812f2-921c-49ee-84d4-427ffe7e07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:33.823326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3812f2-921c-49ee-84d4-427ffe7e07ab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:33.823605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3812f2-921c-49ee-84d4-427ffe7e07ab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:33.823878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3812f2-921c-49ee-84d4-427ffe7e07ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:33.894407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:33.899874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3812f2-921c-49ee-84d4-427ffe7e07ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:33.903283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3812f2-921c-49ee-84d4-427ffe7e07ab None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:34.019484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 345/685] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 12:16:34.029059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:34.062403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:34.082710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bfe6-080e-4aba-8cee-adae18d71c2a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.083059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bfe6-080e-4aba-8cee-adae18d71c2a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.083268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bfe6-080e-4aba-8cee-adae18d71c2a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.084965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 346/686] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:34.092438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.092763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.093007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.115239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:34.116452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:34.151374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5296-7772-49a2-9fb4-7365361b9445 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:34.207655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 347/687] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:34.214467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:34.215105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.215383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.215653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.229769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:34.231216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:34.251117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:34.252095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:34.252983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:34.252983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:34.252983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:34.252983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 341/688] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:34.257871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:34.307194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:34.420163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eed9d-9dda-47b1-804e-e8e8c3bfbf41 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:34.469564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:34.470180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.470457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.470728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.471375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:34.471673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:34.473122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:34.490842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 348/689] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:34.496881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:34.560203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:34.602661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:34.663273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:34.667798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c75b1b-ba18-48bd-b707-d3bbb7408882 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:34.678317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf5bd8-cd49-4e3b-9428-e9cfd5e59877 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:34.722092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:34.724275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.725926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.726401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.743640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:34.745003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.745637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.748011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.750782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:34.756291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:34.757204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:34.758078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:34.764735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:34.766398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:34.767768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 349/690] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:34.783642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:34.784677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:34.785799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:34.787334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:34.799165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 342/691] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:34.802747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:34.908421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285005-265b-49b1-9f2f-4a8fd869f782 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:34.921833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ba10d-2a52-4604-966f-6aa060015721 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:34.953466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:34.954399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.954399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.954686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.955347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:34.955652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:34.957099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:34.965149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:34.966114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:34.966681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:34.967293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:34.970967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:34.971537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:34.973252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:34.977091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:34.981482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 350/692] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:34.987018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.003315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 343/693] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:35.009382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.012529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:35.122520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484741-cbd1-4ae4-972f-d0615c175625 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:35.159319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:35.159894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.160196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.160467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.174452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:35.175900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:35.177017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7fc7f-7418-45be-a625-f2014317906e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-80825cbf-55f1-41dc-bb27-78300ccce0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:35.191151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:35.192159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:35.193034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:35.193034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:35.193034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:35.197330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 351/694] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:35.198666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8113f-212b-4bec-8af0-eb1d59f7aa7d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.198952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8113f-212b-4bec-8af0-eb1d59f7aa7d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.199228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8113f-212b-4bec-8af0-eb1d59f7aa7d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.200925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 352/695] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:35.201635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8113f-212b-4bec-8af0-eb1d59f7aa7d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.225376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:35.227265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.227744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.228249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.229172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=c1605f3029484ea2a5e98a1b10caf075) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:35.229719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:35.231401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b4539-1f1e-4aa8-9247-d0091d58d187 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:35.239020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 344/696] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:35 2022] GET /identity/v3/role_assignments?user.id=c1605f3029484ea2a5e98a1b10caf075&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:35.240593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.241091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.241587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.264646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:35.266218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:35.325834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:35.339525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:35.364622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 345/697] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:35.404198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8113f-212b-4bec-8af0-eb1d59f7aa7d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:35.450779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:35.451309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.451655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.451951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.452602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:35.452904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:35.454259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171216ab-1b60-4535-a27f-8b395c2773b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:35.469559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 353/698] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:35.475555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.595074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588b012-3d5e-47b0-a402-ecda261a3b00 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:35.630663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:35.632545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a86db-f6ee-430a-8b5b-7042d3fefab2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.632742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.633495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.633761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.634208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a86db-f6ee-430a-8b5b-7042d3fefab2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.634676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a86db-f6ee-430a-8b5b-7042d3fefab2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.636503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 354/699] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:35.641599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:35.642254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.642759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.643041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:35.643437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:35.655371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:35.657232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:35.658262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:16:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:35.662084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.669717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:35.671222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:35.714866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:35.765261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 355/701] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:35.768266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.783037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359d9f-d219-4f32-b289-c5159972d8ea None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:35.822668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:35.823643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.824179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.824655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:35.826122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:35.826636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:35.828292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:35.843836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:35.863959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 347/702] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:16:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:35.866536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:35.923857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aa5fb-22a3-4b69-beba-0fd00047372e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:35.997229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:35.997792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:35.998072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:35.998337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.020797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.022241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:36.053825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:36.054844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:36.055819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:36.055819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:36.055819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:36.057293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 356/703] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:36.064179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.064602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06ff92-20c1-467a-a6b3-440613bf00fa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.079535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:36.142493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.143155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.143440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.143718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.189393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c262ad-b19e-46c1-81d5-f008f877d790 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.193595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:36.234432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.235394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.235892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.236389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.237106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.237756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:36.238250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.238555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.240028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.257702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 357/704] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:36.259362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.373837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 348/705] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:36.375087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.375660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34955a11-6010-407c-b08d-bab28d008f47 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.385071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:36.425985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.426626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.427076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.427371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.428123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.430156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:36.443966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:36.445065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:36.446458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:36.449119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 358/706] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:36.455148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.487605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:36.498600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f72459-4ab8-4581-af47-6a7c4ba9a774 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.543163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.544181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.544677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.545148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.546001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.547614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.572606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 349/707] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:16:36 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:36.573598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.576128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50304ca8-d0a8-4615-90be-b0996020c906 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.624091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.624895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.625252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.625598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.639270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.640958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.656253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cd361b61-aa8b-441e-93b4-d6071e5f3188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:36.658569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:36.659877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:36.661424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:36.661424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:36.661424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:36.661780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 359/708] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:36.665884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee514-de01-461d-ae2e-32e9e3b9e918 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.665884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee514-de01-461d-ae2e-32e9e3b9e918 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.665884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee514-de01-461d-ae2e-32e9e3b9e918 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.667664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 360/709] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:36.667664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee514-de01-461d-ae2e-32e9e3b9e918 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.717799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c7404-ad61-421e-b95f-223383a65e31 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.764881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:36.767169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.768303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.768414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.768616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.769253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:36.769554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.771494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f91f3-9cf7-472e-9a29-1c2081160d28 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.781178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 350/710] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:36.782458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.782740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.783016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.792756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee514-de01-461d-ae2e-32e9e3b9e918 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:36.802252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:36.803428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:36.837368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:36.838102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:36.838360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:36.838630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:36.839631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:36.839741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:36.841105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:36.856649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 361/711] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:36.857501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.893335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 351/712] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:36.894456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:36.998582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:37.025989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407eafe-3aef-4886-a174-ca0790c39d9a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.062159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.063112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.063604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.064103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.064949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:37.065448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.067011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.073223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 362/713] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:37.080049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9d733-c075-45f3-9b8a-a755b7aa5600 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.150904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.151562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.151838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.152130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.165785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.167263 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:37.183235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:37.184292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:37.185178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 352/714] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:37.190394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:37.209386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:37.255255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:37.339956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804d60d-caf2-49cc-946e-cf1116bf99c2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.401106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f60c-3023-4ecb-b12f-5343f1a468a4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.412217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.412844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.413124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.413395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.414169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:37.414977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.416500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.436324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:37.446211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 363/715] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:37.451876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:37.469598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.470253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.470532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.471071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] PATH_INFO: `/v3/services/network` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.471663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.473073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:37.495056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:37.496758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:37.498803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 353/716] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:37 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:37.506434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:37.593550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:37.654545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dd40b-eb7a-4dee-9095-2c4099241a92 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.669283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501bba3-5238-4cbb-bfb8-e97365d0c552 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.713662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.714631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.715270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.715782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.716353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.716964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.717083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=d671292a536e4a61931f1127f63c2883) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:37.717258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.717498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.717937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.718123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:37.718424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.719778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b1261-ac36-4395-8394-050d9304d1d7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.720175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.732085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 364/717] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:37 2022] GET /identity/v3/role_assignments?user.id=d671292a536e4a61931f1127f63c2883&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:37.735497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 354/718] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:16:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:37.741410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:37.856984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6344-fbd6-4ce6-a21f-8d7745e17d52 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.857295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6344-fbd6-4ce6-a21f-8d7745e17d52 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.857479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6344-fbd6-4ce6-a21f-8d7745e17d52 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.859109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 355/719] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:37.864975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.865255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.865532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.887071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:37.889006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:37.891867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030e97-cd15-4922-b9d1-326d98313dba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:37.946083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:37.946953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:37.962779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:37.963417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:37.963697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:37.963989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:37.964644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:37.964943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:37.966328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:37.976872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 365/720] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:16:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:37.992913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 356/721] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 12:16:38.272184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:38.385081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70486ef-ebd2-411f-a982-2820851b6fe0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:38.420348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:38.421816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:38.422296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:38.422837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:38.436372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:38.441958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:38.442884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:38.443711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:38.446832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 366/722] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:38.452476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:38.568564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3e018-19e0-4f07-940b-8c8b8a1b1c48 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:38.608985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:38.609968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:38.610474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:38.610941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:38.611799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:38.612325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:38.613874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:38.626086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 357/723] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:38.631879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:38.687131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:38.750102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9ec1b-63a4-412b-8214-5c44bff47bf4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:38.796631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:38.797281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:38.797568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:38.797844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:38.815695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:38.817184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:38.836462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:38.837582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:38.838493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:38.838493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:38.838493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:38.838493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 367/724] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:38.843827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:38.896969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:38.985942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd3d70-769a-4a47-a576-391c9f3102cf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:39.032743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:39.033284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.033563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.033837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.034483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:39.034787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:39.036179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf80f8-180a-449c-868b-505df8d15bcb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:39.055268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 358/725] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:39.060412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:39.218523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295a7d-4b10-4708-a2db-d2e89cf84b1e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:39.220886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:39.253635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:39.254277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.254558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.254830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.263348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:39.264841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:39.274086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221be0-e004-4afc-81af-cdb1b8e78bf6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.274705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221be0-e004-4afc-81af-cdb1b8e78bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.275191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc221be0-e004-4afc-81af-cdb1b8e78bf6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:39.276952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:39.277878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:39.278801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 368/727] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:39.279896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 359/727] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:39.285070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:39.285805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.286179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.286544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.306916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:39.308864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:39.405306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 360/728] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:39.446857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62755b5-9888-4cdf-a1e0-645ec87007bc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:39.489167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:39.490063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.490522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.490944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.491867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:39.492402 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:39.494459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:39.535179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 369/729] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 22 12:16:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:39.541131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:39.581784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:39.690547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd7b9f-5bcd-4678-a7eb-d96c2f281e51 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:39.711702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:39.738031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:39.753327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cd5c-6d56-47cc-85b8-ba3ed178512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:39.753327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd5c-6d56-47cc-85b8-ba3ed178512e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.753576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd5c-6d56-47cc-85b8-ba3ed178512e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.753804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cd5c-6d56-47cc-85b8-ba3ed178512e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.839558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cd5c-6d56-47cc-85b8-ba3ed178512e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:39.841205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cd5c-6d56-47cc-85b8-ba3ed178512e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:39.860716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653370fb-9297-4cca-9dad-f32b0bc2697a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:39.872142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:39.899153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67676826-135e-454b-bee7-d756bee2d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:39.900085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67676826-135e-454b-bee7-d756bee2d99e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.900541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67676826-135e-454b-bee7-d756bee2d99e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.900960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67676826-135e-454b-bee7-d756bee2d99e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.912315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67676826-135e-454b-bee7-d756bee2d99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-67676826-135e-454b-bee7-d756bee2d99e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:39.917771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:39.918885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:39.919782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:39.922016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 370/730] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:39.923469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062ff3-ff0c-4284-91c3-262b5ccaaa65 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.923958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062ff3-ff0c-4284-91c3-262b5ccaaa65 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.924438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062ff3-ff0c-4284-91c3-262b5ccaaa65 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.931119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 371/731] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:39.932184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a062ff3-ff0c-4284-91c3-262b5ccaaa65 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:39.960594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 361/732] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:39.962077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:39.962489 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:39.962842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:39.984852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:39.986266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:40.023781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.045131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a062ff3-ff0c-4284-91c3-262b5ccaaa65 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.064709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 362/733] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:40.065948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.112168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.112808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.113439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.113911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.114726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:40.115277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.116814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.131439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.138111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 372/734] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:40.144077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.237875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42c0a-4fa8-4370-94cd-ce966378d432 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.299603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.306601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.306601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.306601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.330565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.332079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.352353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957e52d-3319-4799-a382-84a124662f3f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:40.367982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:40.369262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:40.370705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:40.370705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:40.370705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:40.370705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 363/735] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:40.388319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.403353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.404020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.404305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.404581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.416236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.417935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.421063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:40.438438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:40.439431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:40.440352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:40.440352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:40.440352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:40.442498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 373/736] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:40.443785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.525049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b13801-aa70-436e-b5dc-b069d6153c19 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.538019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.557037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d166d9-6868-4346-866f-d21945b7dd14 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.575614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.576324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.576795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.577282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.578169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.579944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.599961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.600707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.601086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.601272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 364/737] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:16:40 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:16:40.601390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.602229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:40.602657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.602885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.604420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.628065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 374/738] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:40.634295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.696360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.734431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc1a20-ff15-43bc-8e1b-a555bc8f86b0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.746637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037147-579b-40ec-8ead-bfcf65e40ffa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.778147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.779229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.779717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.780364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.781465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:40.781991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.783732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102cd81-bb84-431b-a191-5cdbb212bc2d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.786649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.787542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.787665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.787846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.796528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.798024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:40.800899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 365/739] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:40.802541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f194a23-a0e1-49a4-96f3-739e810f34d5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.803030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f194a23-a0e1-49a4-96f3-739e810f34d5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.803513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f194a23-a0e1-49a4-96f3-739e810f34d5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.806119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 366/740] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:40.807157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f194a23-a0e1-49a4-96f3-739e810f34d5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-eb624e29-fc4c-4fad-acff-eccc45a55127 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:40.812060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:40.813295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 375/741] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:40.814218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.814762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.814762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.838829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:40.840087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.840201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:40.922186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 376/742] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:40.922963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:40.934278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f194a23-a0e1-49a4-96f3-739e810f34d5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:40.975173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:40.981809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:40.982463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:40.982834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:40.983118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:40.991349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:40.993489 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-051caaf4-26be-47cb-84bf-07a20b1a5ae9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:41.006734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:41.007693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:41.008709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 367/743] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:41.009781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9dcc-bdcc-4ebc-a4f3-01c9b6bad5cf None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.009781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9dcc-bdcc-4ebc-a4f3-01c9b6bad5cf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.009949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d9dcc-bdcc-4ebc-a4f3-01c9b6bad5cf None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.015886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 368/744] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:41.016650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9dcc-bdcc-4ebc-a4f3-01c9b6bad5cf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.045346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c24f8-e9e5-4f19-88c5-a8238a554d72 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.088820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.090064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.090554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.091185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.092406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:41.092946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:41.095005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206b13f-9893-4aca-b064-61ee01b3ec4c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.116077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 377/745] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:41.116077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.116077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.116077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.138342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:41.139001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:41.141392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:41.162861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d9dcc-bdcc-4ebc-a4f3-01c9b6bad5cf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.200955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.201729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.202367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.202746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.203494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:41.203801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:41.205500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.224725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 369/746] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:41.225944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.229024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 378/747] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 12:16:41.230167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.265011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:41.338263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1a5da-7ea8-4765-bec5-c34370f32532 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.374916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.375531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.375812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.376132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.379370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dfe53-c152-4270-b3f7-6d180b970be0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.386905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:41.391747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:41.392724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 379/748] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:41.399283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.433330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.433950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.434231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.434507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.435245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=c1605f3029484ea2a5e98a1b10caf075) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:41.435555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:41.437023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.448313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 370/749] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/role_assignments?user.id=c1605f3029484ea2a5e98a1b10caf075&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:41.449197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.473248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:41.524650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:41.532053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b0320-1d02-47e7-98ef-33bf2b3cc5a6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.581358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.583277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.584080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.584545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.635364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecff249-4a8a-44bc-9c6f-a53093c6be54 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.683887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.684532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.684813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.685086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.685786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:41.686091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:41.687456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.691722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:41.693558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.700252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 371/750] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:41.701128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.780300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:41.797941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:41.810400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 380/751] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 12:16:41.811419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.817209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e000-f6d5-4ae9-8517-f8b2af67cd73 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.853388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.854318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.854748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.855173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.855998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:41.857561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:41.877049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 372/752] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:16:41 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:41.878376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:41.925690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c953edf-3398-4346-b0c7-1ef73488eeda None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:41.986496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:41.987147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:41.987689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:41.987800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:41.995369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb834ce-9319-4c36-8863-3c70f14af2fa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.008443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.010097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.035666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:42.040112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:42.041063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:42.041954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:42.041954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:42.041954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:42.048126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 381/753] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:42.048126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.050315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.051124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.051405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.051692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.074900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.076416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.106449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:42.108903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:42.109844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:42.110762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:42.110762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:42.110762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:42.112779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 373/754] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:42.119339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.204240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd2c0f-b278-4240-8079-f32d40651283 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.244770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.245297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.245623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.245891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.246528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:42.246822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.248221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.263582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 382/755] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:42.275963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.281142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020f4e2-85c5-43d1-983c-d0d2dfa1f850 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.324164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.324835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.325123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.325402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.326052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:42.326357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.327741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.346624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 374/756] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:42.353813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.423294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:42.458781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa189ab9-26e7-4a43-bde2-37d540ec3643 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.465649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:42.490652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8dd9-d4fc-407b-ba4d-7cfa269dce75 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.536023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.536584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.536860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.537133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.548612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.550055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.555295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.555958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.556243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.556508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:42.567198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:42.568129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:42.568995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 375/757] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:42.573978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.575171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.577231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:42.594720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:42.596300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:42.597232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:42.598145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 383/758] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:42.609047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.699686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:42.703853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a7c87-8972-4475-9042-9f96e9ac08f5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.718966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a041a-9e40-4734-9558-cc46faeaeacb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.762567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.764086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.764944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.765754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.766226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.766691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.767163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.768103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:42.768567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.769482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:42.769979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.771597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.772148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.774279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.797975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 376/759] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:42.803670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.807607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 384/760] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:42.814950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:42.857880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:42.915161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bfebb-ef41-422a-839e-38d9e05a4742 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:42.950767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:42.951727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:42.952307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:42.952817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:42.953754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=57e9b176a3c148f79b4a406b74631713) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:42.954268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:42.955921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:42.962906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 377/761] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/role_assignments?user.id=57e9b176a3c148f79b4a406b74631713&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:42.988398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824cb18-fd70-421d-bb43-0a4d297a9650 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:43.064729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:43.065740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.066223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.066717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.083640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:43.085642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-123c88b1-258e-448e-b9a6-42e41bd6e358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:43.111852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:43.112912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:43.113847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:43.113847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:43.113847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:43.115842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 385/762] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:43.122062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:43.125553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3601e-ab37-40e4-a19f-b6adca115408 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.125837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3601e-ab37-40e4-a19f-b6adca115408 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.126110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3601e-ab37-40e4-a19f-b6adca115408 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.127860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 386/763] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:43.139062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.139392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.140917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.156315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:43.173271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:43.174566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:43.273272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4bcc0-adb4-46b2-9fb5-17d6646c8739 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:43.290002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 387/764] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:16:43.315480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:43.316401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.316867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.317325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.318141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:43.318647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:43.320791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:43.333035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 378/765] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:43.340327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:43.360294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:43.464080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b9097-6d10-4049-aaee-ec5823ccb27f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:43.498300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:43.498930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.499208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.499481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.515687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:43.517197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:43.531005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:43.531892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:43.533372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 388/766] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:43.537809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:43.612334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:43.661454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:43.696644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ec637-be43-4a6d-80d3-e91b47d8ac06 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:43.721769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:43.763786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:43.765961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.767174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.767802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.769785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:43.770477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:43.772810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:43.795131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 379/767] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:43.800374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceaec6-e302-4641-8535-79e6bc4391fa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:43.802807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:43.872208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:43.872870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.873182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.873461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.874060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:43.875434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:43.894625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:43.895635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:43.897043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 389/768] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 22 12:16:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:43.901484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:43.931478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6bc8-c62d-492e-a6ca-f9a3a3bdd5d3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:43.966754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:43.967903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:43.968424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:43.968894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/d671292a536e4a61931f1127f63c2883/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:43.971130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=d671292a536e4a61931f1127f63c2883, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:43.972782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:43.996006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 380/769] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:43 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/d671292a536e4a61931f1127f63c2883/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:44.072685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7360d-a588-44c7-a591-f7f4d904f5c0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:44.121162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:44.131900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:44.133374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.133913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.134379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.135205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:44.135701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:44.137289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe1ce1-dc86-4be0-88cd-5abf82d1705c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:44.142601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 390/770] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 22 12:16:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:44.149012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:44.161259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:44.220247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c336d-fa03-4bc9-977b-5a8e56e65940 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.220876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c336d-fa03-4bc9-977b-5a8e56e65940 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.221385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c336d-fa03-4bc9-977b-5a8e56e65940 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.224386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 391/771] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:44.229828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.230455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.231090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.250694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:44.252360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:44.342857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f40f-dc65-49a9-839d-db93b1b641c7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:44.367986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 392/772] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:16:44.394568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:44.395115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.395387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.395660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.396331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:44.396637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:44.398073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:44.405141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 381/773] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 22 12:16:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:44.410512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:44.547211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773b9c-e4bd-47c1-b388-e53d1eb1e3c5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:44.578502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:44.596643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:44.597270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.597596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.597918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.599088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] RBAC: Adding query filter params (interface=public, service_id=12ae6353ef434e3a929d8cff43f8724d, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:44.599663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:44.601840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4830ba-12e0-476d-8c2a-ce0fa5ec47b7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:44.611655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 393/774] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:16:44 2022] GET /identity/v3/endpoints?service_id=12ae6353ef434e3a929d8cff43f8724d&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:44.617338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:44.706610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:44.751645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b06de-5c89-41e7-907e-3273df804e23 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:44.787067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b7fbc-e28a-47c0-935b-f51cdba2e460 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.787611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b7fbc-e28a-47c0-935b-f51cdba2e460 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.787611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b7fbc-e28a-47c0-935b-f51cdba2e460 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.789276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 394/775] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:44.794306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.794691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.794970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.797078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:44.797696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:44.797980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:44.798257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:44.798871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:44.800446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:44.806475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 382/776] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:16:44 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:44.837659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:44.839263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:44.893229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:44.995633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 395/777] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:45.042047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4fb5b-782c-4e3b-a1df-fd40441bd309 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.076366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:45.082930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.083888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.084666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.085181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.096789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:45.103457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:45.104419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:45.105270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:45.107873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 383/778] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:45.117037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.231687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148da9-aed7-4d02-b8b5-7f31da71f225 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.249930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:45.274335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.274961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.275241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.275509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.276220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:45.276525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:45.277888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:45.290937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 396/779] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:45.295556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.296551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.407340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e9a98-7feb-4fc5-a516-0bde95f3fd94 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.441041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.441686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.441969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.442245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.453691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:45.455166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:45.470482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:45.471461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:45.472364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:45.472364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:45.472364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:45.472364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 397/780] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:45.477486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.516479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:45.529875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b17c7-f717-4958-90a3-cc0c13fece74 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.577460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.578622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.578906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.579466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] PATH_INFO: `/v3/services/network` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.580091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:45.582482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:45.591042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f383ce-c357-4819-8bc4-b30704579192 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-81dc1eea-85f0-4275-97b4-89772f986bed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:45.595261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:45.596264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:45.597081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 384/781] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:45.598944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b104-161b-41ab-a60f-1ff79e88416e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.599241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b104-161b-41ab-a60f-1ff79e88416e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.601063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405b104-161b-41ab-a60f-1ff79e88416e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.605895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 385/782] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:45.606998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405b104-161b-41ab-a60f-1ff79e88416e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.631462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.632108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.632388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.632663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.633966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:45.634273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:45.635656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa4e6-216d-4ea3-a625-78e3546fbed0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:45.653527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 398/783] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:45.654821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.655124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.655375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.675005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:45.676222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:45.684737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:45.723036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405b104-161b-41ab-a60f-1ff79e88416e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.746406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 399/784] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:45.747317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.768867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:45.778822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.779660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.779957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.780250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.780886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] RBAC: Adding query filter params (name=network) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:45.781195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:45.782779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:45.794424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 386/785] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:45.800953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.848679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4783254-19ec-4404-ab9c-3534091ae81d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.884854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:45.885499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:45.885779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:45.886053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:45.893347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:45.894908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:45.906522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:45.908752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:45.911043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 400/786] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:45.915991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:45.968714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184bdaf-3dab-4de7-9689-22eec8da6d61 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:45.996235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.008428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.009329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.009815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.010388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.011320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] RBAC: Adding query filter params (type=network) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:46.011867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.013657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.016134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.016921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8937e-7c2a-485e-82aa-1da2dcc6654a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.019982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 387/787] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:46.026172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.053250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.053918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.054201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.054477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.055903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:46.056235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.057659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.083965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 401/788] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 22 12:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:46.083965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.183873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f4d60-f776-4feb-aabf-0613bf6f3ced None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.220749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.221461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.221666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.221939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.229309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.233950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.235528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.241341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c525a12-320c-4fd2-88a2-33637adebf40 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:46.251721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:46.252971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:46.254068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:46.254068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:46.254068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:46.254460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 402/789] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:46.255181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.282690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.283706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.284216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.284754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.285814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] RBAC: Adding query filter params (interface=public, service_id=759b2cddb4db4eae8f296d7a8ac988e5, region_id=RegionOne) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:46.286323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.288087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.301614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 388/790] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/endpoints?service_id=759b2cddb4db4eae8f296d7a8ac988e5&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:46.302787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.356353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.363677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f52a63-bc51-41c7-85dd-631cd1a83240 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.399144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.399772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.400072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.400344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.410645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:46.411296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a24b-9411-468a-b361-b118bcf3f28f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:46.416088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:46.417009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:46.417848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:46.422266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 403/791] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:46.422960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.452248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.453261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.453744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.454219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.455154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:46.455829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.457497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.471162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 389/792] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:46.472810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.479010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.537999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220bb6d-815b-4527-90b1-fd635160abd7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.576506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.577770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.577770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.577770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.578316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.579727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.591965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 404/793] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:46.591965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.636789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66cf53-d46a-4c88-aab5-61649cfcb258 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.653330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.684177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.685318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.685808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.686285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.687199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:46.687724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.689566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff24ef-af33-4d1b-89b4-df7ed3d7db26 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.698886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0746-1331-4afa-bfa0-fd3aa2e2de0b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.706260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 390/794] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:46.707893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015dd8a-170e-4b96-b708-f49841fccb26 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.708398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015dd8a-170e-4b96-b708-f49841fccb26 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.708838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015dd8a-170e-4b96-b708-f49841fccb26 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.710593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 391/795] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:46.712514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015dd8a-170e-4b96-b708-f49841fccb26 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.720868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:46.744926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.745578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.745855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.746123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.753885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.755460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-32c597d3-34ab-47e9-8758-a63b207589aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:46.771664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:46.772672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:46.774176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:46.778627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 405/796] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:46.780047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.780338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.780606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.800621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:46.802184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:46.846889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015dd8a-170e-4b96-b708-f49841fccb26 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:46.888370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:46.889178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:46.889529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:46.889871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:46.892025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 406/797] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:46.893039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.913670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:46.915830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:46.944324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:46.945404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:46.946312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:46.946312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:46.946312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:46.948865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 392/798] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:46.954343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:46.989770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.045387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2774-991e-467a-865c-21340e23ddf2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.060171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.066279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e981d-a1d6-4d9b-8a13-07db29eaaad6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.102491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.103087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.103361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.103631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.104293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:47.104596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:47.105954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:47.107958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.108765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.109116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.109461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.110226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:47.110601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:47.112171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:47.117730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 393/799] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:47.123410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.124986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 407/800] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:47.130434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.272294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695da10-82a8-4866-b650-07c844b44ddc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.288660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.308190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0cc5e-10f7-4a32-a984-89d5a07a1375 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.311343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.312270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.312698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.313117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/c1605f3029484ea2a5e98a1b10caf075/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.315331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=c1605f3029484ea2a5e98a1b10caf075, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:47.317126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:47.334386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 408/801] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:47 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/c1605f3029484ea2a5e98a1b10caf075/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:47.336574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.344721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.345537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.345939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.346302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.356243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:47.357890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:47.371451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:47.372662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:47.373625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:47.378599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 394/802] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:16:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:47.380055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.497123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.517844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369a46e-0dfb-4d95-8e7c-6f67e542bbe5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.568580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.569501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.569966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.570957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.572532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:47.573067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:47.575313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db6e68-d1c6-43c3-b96f-b962f2c939de None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:47.585070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ae403-bf84-4c5a-b0a2-527743805592 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.597269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.603694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 395/803] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 22 12:16:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:47.609784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeebdf-3458-481e-8a9f-5a2283f49c98 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.612339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeebdf-3458-481e-8a9f-5a2283f49c98 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.612694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeebdf-3458-481e-8a9f-5a2283f49c98 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.614562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 396/804] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:47.615629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeebdf-3458-481e-8a9f-5a2283f49c98 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.639760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff28c99-6293-4200-a483-1600d6acf9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.641515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28c99-6293-4200-a483-1600d6acf9be None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.641872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28c99-6293-4200-a483-1600d6acf9be None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.642192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28c99-6293-4200-a483-1600d6acf9be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.657487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff28c99-6293-4200-a483-1600d6acf9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cff28c99-6293-4200-a483-1600d6acf9be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:47.664112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:47.665204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:47.666216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:47.670032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 409/805] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:47.671795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.672113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.672378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.696138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:47.698047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:47.746403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeebdf-3458-481e-8a9f-5a2283f49c98 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:47.788156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 410/806] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:47.789466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.807332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:47.808357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:47.808907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:47.809384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:47.817071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.830896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:47.832471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:47.854098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:47.855687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:47.856666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:47.856666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:47.856666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:47.858269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 397/807] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:47.863566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:47.920198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:47.985224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67acc81-9bda-418a-9926-04bc1c099aef None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.028572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4744e-d59b-4450-89ab-563167544a39 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.045825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.046443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.046723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.046994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.047639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:48.047961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.050797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.094907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.095460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.095739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.096033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.096718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:48.097020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.098390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.118308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 411/808] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:48.119137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.216110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:48.227202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 398/809] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:48.228372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.252111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22f3a1-3108-4f97-8326-f734e220b98c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.295969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.297016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.297297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.297569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.298156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.299517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:48.312471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:48.313451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:48.314307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 412/810] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:48.315099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.363842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b904ef-babc-4d17-b7b1-ec3a44d88d2e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.380035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:48.401758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.402382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.402658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.402922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.412897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.415005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:48.429110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:48.430639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:48.431573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:48.431573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:48.431573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:48.431573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 399/811] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:48.432313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.441607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db84d82-30f3-43c7-96d4-0e513790e62f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.483033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.484156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.484731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.485203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.493557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.495776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.498608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:48.510103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:48.510996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:48.511870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:48.514405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 413/812] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:48.515457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.538756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4810-d98e-4946-be28-03c877455eb5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.574633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.575247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.575522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.575790 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.576449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:48.576752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.578103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.584320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 400/813] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:48.585536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.621673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:48.633401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86426e8b-3dd8-47f6-a9bd-0b05cb63fec4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.670935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.672120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.672606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.673079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.673941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:48.674518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.676223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.689829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 414/814] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:48.690930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.709731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf2b69-0cc4-4ac5-b68b-201762d5dc41 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.752650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.753382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.753675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.754062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.754750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:48.755056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.756973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.760121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:48.772054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 401/815] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:48.774537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.813416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c12830-7c01-45a6-8675-a937d83dd383 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.850040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.850732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.851011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.851359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.852683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:48.852986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.854351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.859788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 415/816] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:48.860640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.895011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:48.908464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4201-32db-4bb9-8165-425a95284a63 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:48.946310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:48.946947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:48.947227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:48.947567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:48.957072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:48.958752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:48.972859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:48.973890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:48.974836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 402/817] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:16:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:48.975433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:48.994764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138483e-539c-451e-88e7-29432562ea4f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:49.031357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:49.052063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:49.053318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.054280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.054812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/57e9b176a3c148f79b4a406b74631713/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.074621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=57e9b176a3c148f79b4a406b74631713, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:49.076994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:49.092868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 416/818] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:16:48 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/57e9b176a3c148f79b4a406b74631713/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:16:49.094019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:49.100478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011969c4-36b9-49c3-b2f3-69256f9d5891 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:49.140859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bb9d3-4875-4495-858f-3c96cc361055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:49.141547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bb9d3-4875-4495-858f-3c96cc361055 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.141835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bb9d3-4875-4495-858f-3c96cc361055 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.142110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bb9d3-4875-4495-858f-3c96cc361055 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.142839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bb9d3-4875-4495-858f-3c96cc361055 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:49.144269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bb9d3-4875-4495-858f-3c96cc361055 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:49.181454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 403/819] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:16:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:49.182668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5490-0915-4730-96c5-19aea0b35c13 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.182956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5490-0915-4730-96c5-19aea0b35c13 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.183231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf5490-0915-4730-96c5-19aea0b35c13 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.190528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 404/820] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:49.192147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.195162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.195162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.210327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:49.225685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:49.227449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:49.327098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 405/821] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:49.344843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638551f-1a78-409c-9eeb-5ed55f02e4e1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:49.389453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:49.390469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.390945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.391436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.392418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:49.392991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:49.394694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:49.420390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 417/822] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:16:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:49.425756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:49.537347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f235ec8-1ac8-4b5e-acfc-1eeb2725d7c2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:49.571664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:49.578541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:49.580225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.580659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.581093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.653714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:49.655494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:49.684074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:49.743354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:49.769762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 406/823] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:16:49.776588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:49.846995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd0ae7-c122-422e-ad89-155276e40c78 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:49.852750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:49.887627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:49.888287 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.888564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.888835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] PATH_INFO: `/v3/services/network` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.889415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:49.890769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6d933ab1-6767-45bd-81c0-b00c1b1ab5ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:49.900235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:49.901243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:49.902062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 418/824] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:49 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:49.902839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e40ec-5a30-4f32-bfaf-b2174d3de2c2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.903434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e40ec-5a30-4f32-bfaf-b2174d3de2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.903434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e40ec-5a30-4f32-bfaf-b2174d3de2c2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.906116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 419/825] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:49.912468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e40ec-5a30-4f32-bfaf-b2174d3de2c2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:49.944759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6c3e-6a14-4cd4-9f0f-af18cf97ad46 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:49.979024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:49.979709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:49.980013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:49.980286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:49.990805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:49.992982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1342bbf2-51f0-4bdc-bc10-6b10ddafb58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:50.009335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:50.010331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:50.011205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:50.011205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:50.011205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:50.011205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 407/826] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:50.012166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.012475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.012747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.025618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:50.030956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:50.032267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:50.034068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e40ec-5a30-4f32-bfaf-b2174d3de2c2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.072356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.073332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.073812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.074305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.075235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:50.075733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.077335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.087867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 420/827] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:16:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:50.089050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.112031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 408/828] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:50.112031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.119548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:50.207728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41274a-c7bc-4bcb-981b-74fbcb7b0663 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.243379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.244017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.244553 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.244830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.245457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] RBAC: Adding query filter params (type=network) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:50.245757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.247200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.253600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 409/829] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:50.264368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.275348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4161ee-c44c-40ba-9da0-200804e037d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.309639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.310247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.310528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.310798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.311438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:50.311737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.313125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.325853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 421/830] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:50.336931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.381298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:50.409644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:50.442286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed16fe-9459-4cc1-be63-cedfa0dab985 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.483179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.483818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.484134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.484406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.485065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.486421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.517815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 410/831] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:16:50 2022] POST /identity/v3/endpoints => generated 337 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:50.524157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.535725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce6793-4555-4308-8efd-bcbb77b8b289 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.586453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.587106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.587380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.587646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.608982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.610529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:50.641870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:50.642784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:50.643670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 422/832] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:50.651238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.722205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546fd5a-cfe9-4934-bd94-2c499b2bd605 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.766198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:50.773882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.775285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.775584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.776005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.784988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:50.787529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:50.794852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:50.795778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:50.796663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 411/833] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:50.801670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.815268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57966f-5c19-461e-a861-4f6fbb84dbbb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.853196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.853812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.854090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.854363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.855060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:50.855365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.856849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.870047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 423/834] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:50.876918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:50.922030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab6288-6132-44c8-967b-4c811c4e28a3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:50.965585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:50.966339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:50.966504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:50.967529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:50.968236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:50.968545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:50.970601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:50.984672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 412/835] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:50.989649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:51.002425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b33c29-3067-40d7-8436-114ec8e93f34 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:51.045709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:51.046333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.046638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.046910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.047691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=d671292a536e4a61931f1127f63c2883) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:51.048624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:51.050172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:51.053705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:51.058002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 424/836] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/role_assignments?user.id=d671292a536e4a61931f1127f63c2883&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:51.067840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:51.119716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e43e5-02f5-4e20-8441-6a2ed69715e9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:51.157520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:51.158474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.158993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.159442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.171645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:51.173580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:51.190011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:51.191024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:51.191900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:51.191900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:51.191900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:51.193945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 413/837] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:51.206402 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:51.310702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130996d-efa9-4e67-bf4c-b9f35ff207b8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:51.346182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:51.346787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.347064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.347333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.347991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:51.348295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:51.349642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:51.361999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 425/838] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:51.367252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:51.479244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b5374-fdac-4761-a046-b3c51ec938d6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:51.486993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:51.515338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:51.516293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.516783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.517313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.525718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:51.527474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d823c207-9e3e-43ec-9b74-0ed834ed9110 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:51.539051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:51.540022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 12:16:51.541123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:51.543258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 414/839] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:16:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:51.548709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:51.571619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378d9f3-9f92-47d6-8466-4ea37e7d5458 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.572089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378d9f3-9f92-47d6-8466-4ea37e7d5458 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.572469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378d9f3-9f92-47d6-8466-4ea37e7d5458 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.574160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 415/840] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:51.579050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.579433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.579900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.599879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:51.601490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:51.616816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:51.666610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd4de-c2ad-4a71-9e8a-934d1c37cd0a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:51.684324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 416/841] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:16:51.702516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:51.703190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.703472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.703743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.704510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:51.704818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:51.706241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effd047-f140-4a08-9c3f-97cf3e900168 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:51.728285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 426/842] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 22 12:16:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:51.729973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:51.827840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:51.833533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc4ef-b063-42d0-9ba5-2530fece2a70 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:51.867001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe638e-6904-4673-818f-c949c86e9c28 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.867830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe638e-6904-4673-818f-c949c86e9c28 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.868130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe638e-6904-4673-818f-c949c86e9c28 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.870327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:51.871125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.871552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.871997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.873731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 427/843] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:51.875256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:51.875543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:51.875816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:51.896926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:51.898513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:51.951722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:51.954273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:51.970637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 428/844] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:51.971550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.023795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.069572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.081636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526e252-8c0c-4c9b-91f3-ae7ff693417d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.082781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 417/845] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:16:52.083845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.115456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.116164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.116512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.116787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.130309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:52.135321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:52.136312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:52.137158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 429/846] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:52.142314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.217314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c8265-6d0c-4d0d-b9b8-017a8df1f2f1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.255172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.255806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.255961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0439-971a-4c10-9ab2-25b86701ca68 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.256143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.256391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.266507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.268899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.270295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:52.284909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:52.285855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:52.286753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:52.286753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:52.286753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:52.286753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 418/847] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:52.286753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.296059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.296671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.296949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.297218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.297877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:52.298170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.299515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.313106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 430/848] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:52.313937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.342299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.396049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124145-3daf-4ff0-b947-ef7d9b56c54b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.421348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f57485-9074-4ab7-89df-d8d5b435eaab None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.433457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.434486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.435065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.435567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.436384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.438197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:52.447542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:52.448672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:52.449502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 419/849] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:52.450278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.459252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.459877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.460189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.460463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.461965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:52.462273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.464226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.478760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 431/850] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:52.479582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.513395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.557418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a98ca-dfaf-41a1-8afe-bcf8502e32c9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.569702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.589263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cfe92-a504-4220-a278-d56eb1996639 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.592870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.593537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.593819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.594156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.606424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.607865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:52.621855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:52.622786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:52.623650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:52.623650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:52.623650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:52.623650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 420/851] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:52.623881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.631735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.632684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.633184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.633828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.634462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:52.634763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.636259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.641160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 432/852] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:52.641886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.732082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754add0-ed8f-4a24-8f99-0b2f8116525f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.741600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.750355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b3c30-5c63-4456-ae2f-549acb63839d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.768464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.769150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.769432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.769703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.777302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.778736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.785102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.785708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.785992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.786266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.786916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:52.787219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.788588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:52.791831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:52.792880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:52.793933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:52.795895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 421/853] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:52.796822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.809184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 433/854] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:52.809184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.830840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:52.912569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4c205-a342-4008-89b5-9b689e6225da None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.914911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2be4-f17b-4763-8549-91c5ead43197 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:52.948746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.949354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.949457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:52.949630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.950000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.950227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:52.950504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:52.950665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:52.950758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:52.950949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.951451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:52.951756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:52.952327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.953195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:52.956971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 422/855] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:52.962208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.972517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 434/856] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:52.973543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:52.991761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:53.084398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:53.099968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb78519-9f10-4df5-bb6e-7f04ae29f33d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:53.118717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c20bff-6996-4835-bd06-c3c5f65ebcf9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:53.140555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:53.141195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.141477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.141734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.151159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:53.152692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:53.165833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:53.166794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:53.167722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 423/857] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:53.172635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:53.173847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:53.174564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.174937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.175297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.176129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=c1605f3029484ea2a5e98a1b10caf075) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:53.177215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:53.177977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:53.186386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 435/858] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:52 2022] GET /identity/v3/role_assignments?user.id=c1605f3029484ea2a5e98a1b10caf075&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:53.297726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49472923-2802-4e6b-a7d0-15706f028d19 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:53.340483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:53.341034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.341318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.341597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.342350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:53.342659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:53.344140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08933b3-3d48-42f3-82af-4af96bfe6536 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:53.364476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 424/859] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 22 12:16:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:53.371089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:53.440983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018778-b355-4960-a4cf-c12d52843dc1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.441637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018778-b355-4960-a4cf-c12d52843dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.442243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87018778-b355-4960-a4cf-c12d52843dc1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.444178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 425/860] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:53.450806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.451354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.451850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.456420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:53.472304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:53.475087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:53.477569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:53.484105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e885875-7a5e-42e4-971e-d94a5526d173 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:53.525464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:53.526195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.526546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.526891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.567981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 426/861] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:16:53.606963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:53.608666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:53.694168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:53.717976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 436/862] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:16:53.723492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:53.829526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e66078-39f0-47a7-9c8c-ed6514a5f11a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:53.830284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:53.870139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:53.870786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:53.871066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:53.871340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:53.874739 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:53.884358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:53.885849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:53.902137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:53.903140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:53.904037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:53.904037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:53.904037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:53.907867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 427/863] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:53.909060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:53.953435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8041-8775-47f6-a808-75e1c1beac2b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:53.998887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:53.999552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.000004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.000279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.001167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.002531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:54.014513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:54.016689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:16:54.018126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:54.019078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8056-0ee3-4580-869e-49c0ba4377ac None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:54.024203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 437/864] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 22 12:16:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:54.027893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:54.055296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:54.055996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.056283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.056585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.057413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:54.057717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.059310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.076152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 428/865] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:54.081104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:54.081767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:54.136949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:54.144860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1b901-1ea3-4dd2-9ae7-62b140dde63a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:54.184870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:54.185870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.186407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.186857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.187665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:54.188172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.189932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.200279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f20881-ee94-4501-902b-914cdd5a3589 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:54.200589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 438/866] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:16:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:54.201786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:54.237625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:54.238413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.238763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.239116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.246835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.248493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:54.261332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:54.262223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:54.263115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:54.267291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 429/867] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:54.268594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:54.314156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30135b9f-689c-4c29-bf08-ce975bfd10e7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:54.322316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:54.350876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:54.351695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.352277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.352552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.353305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:54.353704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.355252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.360164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 439/868] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:16:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:54.378475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1563611-f9eb-4627-986d-26dc629b3e97 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:54.390282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:54.419482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:54.420432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.420871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.421281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.422149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:54.422674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.424320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edfbec-6025-4f86-9477-96d67afd7a02 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.442805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 430/869] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:54.449064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:54.562222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf733e58-77fa-4a5f-90d8-b570d1c8beb7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:54.598310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:54.598917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:54.599191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:54.599459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:54.600217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=57e9b176a3c148f79b4a406b74631713) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:54.600525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:54.601988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710b4dc-264e-4492-98db-a3c5befb239e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:54.608431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 440/870] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:54 2022] GET /identity/v3/role_assignments?user.id=57e9b176a3c148f79b4a406b74631713&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:55.182979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d048816-8401-4cba-92e5-11ed339df615 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:55.183524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d048816-8401-4cba-92e5-11ed339df615 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:55.183524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d048816-8401-4cba-92e5-11ed339df615 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:55.185114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 431/871] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:55.190610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05931894-995f-40a0-9843-b8992c50a295 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:55.191010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05931894-995f-40a0-9843-b8992c50a295 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:55.191178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05931894-995f-40a0-9843-b8992c50a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:55.210288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-05931894-995f-40a0-9843-b8992c50a295 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:55.212124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-05931894-995f-40a0-9843-b8992c50a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:55.240427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:55.286861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 441/872] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:16:55.475469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1a786-8066-4023-b6fa-9799b30823f7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:55.475771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1a786-8066-4023-b6fa-9799b30823f7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:55.475975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1a786-8066-4023-b6fa-9799b30823f7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:55.477592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 432/873] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:55.482932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69291f0-4fd2-4537-a331-20559451308e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:55.483460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69291f0-4fd2-4537-a331-20559451308e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:55.483962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69291f0-4fd2-4537-a331-20559451308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:55.503095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a69291f0-4fd2-4537-a331-20559451308e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:55.504626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a69291f0-4fd2-4537-a331-20559451308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:55.564552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1a786-8066-4023-b6fa-9799b30823f7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:55.575092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 442/874] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:55.675293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1a786-8066-4023-b6fa-9799b30823f7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:55.711906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:55.712613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:55.712896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:55.713168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:55.713828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:55.715188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:55.734616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 433/875] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:16:55 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:16:55.844452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69291f0-4fd2-4537-a331-20559451308e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:55.946589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:55.955207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69291f0-4fd2-4537-a331-20559451308e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:55.998229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:55.999232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:55.999714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:56.000219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:56.001024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:56.002587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:56.012997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:56.013997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:16:56.014855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:56.017574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 443/876] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:16:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:56.024310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:56.054106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:56.137172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d18995-06fe-488e-97ed-f63574ee3cdd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:56.172408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:56.173324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:56.173752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:56.174195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:56.174981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:56.175432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:56.176965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715b214-549d-4f89-b2e3-8080d4aac4c6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:56.182644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 434/877] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:16:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:56.190859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:56.299089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126f23e-1679-4b29-b5a3-21efd711a1aa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:56.334246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:56.334857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:56.335136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:56.335406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:56.336103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:56.336407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:56.337767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49534273-e579-4097-bf56-6c7a05e5fda2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:56.342641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 444/878] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:16:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:56.584324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd93e7-bae8-4ac3-b950-4ebfc3fd91cf None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:56.584816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd93e7-bae8-4ac3-b950-4ebfc3fd91cf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:56.584816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd93e7-bae8-4ac3-b950-4ebfc3fd91cf None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:56.586360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 435/879] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:56.591751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e183b4-a0c6-42b8-952e-0ef947326959 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:56.592135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e183b4-a0c6-42b8-952e-0ef947326959 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:56.592411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e183b4-a0c6-42b8-952e-0ef947326959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:56.611490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c5e183b4-a0c6-42b8-952e-0ef947326959 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:56.612769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c5e183b4-a0c6-42b8-952e-0ef947326959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:56.627832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:56.686954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 445/880] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:56.955434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd93e7-bae8-4ac3-b950-4ebfc3fd91cf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:57.004396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462a0d4-4e29-4e1c-ba0c-548d136ffb9e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.004736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462a0d4-4e29-4e1c-ba0c-548d136ffb9e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.004953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462a0d4-4e29-4e1c-ba0c-548d136ffb9e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.006542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 446/881] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:57.011677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.011979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.012255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.030783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:57.032006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:57.060444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:57.071323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd93e7-bae8-4ac3-b950-4ebfc3fd91cf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:57.109381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:57.109990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.110264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.110534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.115581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:57.115581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:57.116142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 447/882] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:57 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:57.129435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 436/883] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:16:56 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:57.385638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:57.467632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:57.489145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d9436-f9e3-4f58-ae06-a61dcdc0c6fd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:57.530507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:57.531147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.531425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.531695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.542045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:16:57.546975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:57.547951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:57.548812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 448/884] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 22 12:16:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:57.554270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:57.657985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6ef04-6b22-4a70-b3ce-6b4c8654c599 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:57.693679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:57.694286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.694562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.694829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.696139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:57.696443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:57.697802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:57.706402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 437/885] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:16:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:57.712161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:57.817791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fad29f-3943-4d20-8c4f-d9b2d1d3af90 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:57.852983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:57.854037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.854519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.854989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.866922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:57.868485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:57.873171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9d9a1a20-17b7-4751-bdcf-7702ecba5e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:57.891214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:57.892384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:57.893417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:57.893417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:57.893417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:57.897667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 449/886] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:57.903193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:57.920331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:57.994237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4b36-6fa0-43b9-84a5-e242d97f4056 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:57.994831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4b36-6fa0-43b9-84a5-e242d97f4056 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:57.995038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f4b36-6fa0-43b9-84a5-e242d97f4056 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:57.996649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 450/887] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:16:58.004094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.004570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.004992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.013364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69759db-c950-4273-a0b4-b79f6f5018da None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.034275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:58.035466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:58.053267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.054048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.054326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.055534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.056502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:58.056823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.058700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.074165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 438/888] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:58.079457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.129262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 451/889] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:58.167320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:58.197522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e2e8c-90da-465f-b408-773594cafb0c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.236251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.236888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.237164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.237435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.245424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.246852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:16:58.259162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:58.260122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:58.261645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 439/890] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:58.266196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.372424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b591341-87a7-4c37-8c6a-76c9045932e8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.389155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:58.407949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.408564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.408841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.409112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.409851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:58.410154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.411634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.430106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 452/891] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:58.435406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.438957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.547133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3407bb-cdda-41c3-8172-d18d56330995 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.548832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f5d43-3ec9-4c6f-9d5e-4f20788946b5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.582825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.583455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.583727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.584084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.584597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.585248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.585867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.586519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.586721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.586949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.590428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-589d6198-d1cc-4b1a-87f4-e7585ec5f8fb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:58.595732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:58.596830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:58.597672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 453/892] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:16:58.598492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf782d-8619-442b-9ea6-2a7fb852cd19 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.599106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf782d-8619-442b-9ea6-2a7fb852cd19 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.599106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf782d-8619-442b-9ea6-2a7fb852cd19 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.603965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 454/893] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:58.603965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf782d-8619-442b-9ea6-2a7fb852cd19 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.644638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:58.670066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.671532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.714097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf782d-8619-442b-9ea6-2a7fb852cd19 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.748353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.748957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.749233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.749711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.750115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:58.750413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.751786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb9790-086b-4156-ab5b-99342ce06b78 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.759978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 455/894] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:58.759978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.759978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.759978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.777534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:58.778701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:58.785357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 440/895] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:16:58.785357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.822992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:58.859969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 456/896] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:16:58.859969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.893976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:58.908280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789fd0c-4de5-4849-ac52-548fc444c925 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:58.944287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:58.945268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:58.946308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:58.946779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:58.947620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:58.948178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:58.949744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:58.955366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 441/897] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:58.961977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:58.978463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a012ee5-640f-4c76-a283-4842e8709cb1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.018700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.019367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.019644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.019914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.031653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.033150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:16:59.051619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:59.052695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:16:59.053596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:16:59.053596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:16:59.053596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:16:59.055979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 457/898] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:59.057440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:59.076583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:59.080538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1d3c-b096-4bd3-bae1-b80b9dcded15 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.123883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.124567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.124849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.125125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.125829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] RBAC: Adding query filter params (interface=public, service_id=900c3af16c9941dba2bef16510477a73, region_id=RegionOne) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:59.126145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.127517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.137889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 442/899] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:16:58 2022] GET /identity/v3/endpoints?service_id=900c3af16c9941dba2bef16510477a73&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:16:59.139625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:59.178691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:59.203057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7de4a-93ac-4c87-af47-19d5bff62956 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.238574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.239207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.239484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.239755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.240438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:59.240736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.241994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dec2b-8c1e-4753-bd7e-161b29e01697 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.242107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.259819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 458/900] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:59.259819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:59.284101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.284713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.284993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.285269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.285871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.287229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.293243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 443/901] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:16:59 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:16:59.293859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:59.343592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:59.403483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9317cc3-524b-4c1d-872b-199dd8fbd3aa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.430880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf4a6-ff56-4637-80bd-702ce6ea6d3e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.449448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974fa43-2222-45bf-bddf-f1141436772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.450190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974fa43-2222-45bf-bddf-f1141436772c None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.450466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974fa43-2222-45bf-bddf-f1141436772c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.450741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974fa43-2222-45bf-bddf-f1141436772c None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.451509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974fa43-2222-45bf-bddf-f1141436772c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.452994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974fa43-2222-45bf-bddf-f1141436772c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.470362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.471118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.471400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.471671 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.471771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 459/902] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:16:59 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:16:59.473176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55235-a284-4fd1-8ca8-2bbcd6f077c3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.473458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55235-a284-4fd1-8ca8-2bbcd6f077c3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.473730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e55235-a284-4fd1-8ca8-2bbcd6f077c3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.475049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 460/903] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:16:59.480293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.481288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.481569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.481836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.482567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:16:59.501659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:16:59.502642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:16:59.503517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:16:59.504018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:59.506009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 444/904] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:16:59.508909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:16:59.511314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:16:59.512772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:59.612127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 461/905] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:16:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:16:59.624365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:59.640562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683280cc-d350-4e9e-a83d-bfcdc5bcb977 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.679613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.680893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.681079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.681401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.682086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:59.682392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.683809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.695849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 445/906] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:59.701718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:16:59.811026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e1abc-3d53-4bdc-9013-fbf1d45a67fb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:16:59.841037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:16:59.847786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:16:59.848701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:16:59.849480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:16:59.850108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:16:59.851234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] RBAC: Adding query filter params (role.id=c2129d2d3f844d6da394d6c63024d994, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=57e9b176a3c148f79b4a406b74631713) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:16:59.851626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:16:59.854009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:16:59.860362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 462/907] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:16:59 2022] GET /identity/v3/role_assignments?user.id=57e9b176a3c148f79b4a406b74631713&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=c2129d2d3f844d6da394d6c63024d994 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:16:59.886998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:00.011373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57eff-7a5f-463b-9efd-35b80bc33e57 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:00.049472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:00.050114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:00.050459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:00.050736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:00.051332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:00.052845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:00.066948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:00.067982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:17:00.070258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:00.076571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 446/908] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 22 12:16:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:00.076737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:00.183861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70bbb6-b650-46a2-af1c-fc604d8434cd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:00.222288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:00.222904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:00.223184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:00.223450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:00.224139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:00.224444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:00.225802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:00.231050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 463/909] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:00.236885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:00.250049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:00.342179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11cc66-b404-427b-a1f2-2ae0fcc23d24 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:00.378389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:00.378994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:00.379269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:00.379538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:00.380185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:00.380485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:00.381835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:00.392079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 447/910] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:00.393407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:00.456684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:00.500027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebc9f-15cf-41a7-a1e1-41d1f875f6d5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:00.536750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:00.537367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:00.537643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:00.537914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:00.538649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] RBAC: Adding query filter params (interface=public, service_id=a24075a4490b47d4b97f57c1339550c9, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:00.538951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:00.540902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0770ed-4a16-41f9-8641-824afc7272e0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:00.546607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 464/911] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:17:00 2022] GET /identity/v3/endpoints?service_id=a24075a4490b47d4b97f57c1339550c9&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:00.552152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:00.631545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:00.657200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de54dd-97f2-4c72-926d-7cfa9f8cbf4b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:00.692355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f1664-0ad8-4404-ae06-69899cd4e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:00.693112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1664-0ad8-4404-ae06-69899cd4e780 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:00.693274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1664-0ad8-4404-ae06-69899cd4e780 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:00.693472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1664-0ad8-4404-ae06-69899cd4e780 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:00.694067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f1664-0ad8-4404-ae06-69899cd4e780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:00.695443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f1664-0ad8-4404-ae06-69899cd4e780 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:00.705469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 448/912] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:17:00 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:17:01.610815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cfd57-6d40-4f4b-9883-7de6c1affb36 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:01.610815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cfd57-6d40-4f4b-9883-7de6c1affb36 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:01.610815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cfd57-6d40-4f4b-9883-7de6c1affb36 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:01.612004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 465/913] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:01.617928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ffd2-e1b5-4e6c-b9ac-0a0e5b23be6d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:01.618455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ffd2-e1b5-4e6c-b9ac-0a0e5b23be6d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:01.618956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ffd2-e1b5-4e6c-b9ac-0a0e5b23be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:01.638117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e0e8ffd2-e1b5-4e6c-b9ac-0a0e5b23be6d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:01.639608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e0e8ffd2-e1b5-4e6c-b9ac-0a0e5b23be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:01.707175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 449/914] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:01.869082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f0e6b-727f-43e8-9337-021e8330c763 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:01.870048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f0e6b-727f-43e8-9337-021e8330c763 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:01.870547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f0e6b-727f-43e8-9337-021e8330c763 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:01.872356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 466/915] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:01.877716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700c69-45d7-4b64-ab9f-1e6fc04f9269 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:01.878005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700c69-45d7-4b64-ab9f-1e6fc04f9269 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:01.878546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48700c69-45d7-4b64-ab9f-1e6fc04f9269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:01.896883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-48700c69-45d7-4b64-ab9f-1e6fc04f9269 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:01.898368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-48700c69-45d7-4b64-ab9f-1e6fc04f9269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:01.960564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:01.966414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 450/916] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:01.985413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f0e6b-727f-43e8-9337-021e8330c763 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.099868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f0e6b-727f-43e8-9337-021e8330c763 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.123110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.134832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.135948 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.136231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.136506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.137092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.138460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.147223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8b161-d8c3-4d9f-b793-874e3933cf09 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:02.147697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:02.149227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:02.150055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 467/917] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:17:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:02.151452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8b161-d8c3-4d9f-b793-874e3933cf09 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.151958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8b161-d8c3-4d9f-b793-874e3933cf09 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.153747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 451/918] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:02.157470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.158828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.159343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.159688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.180507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:02.181700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:02.268655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 452/919] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:02.269565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.276171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6517f8e-3520-4dee-afa9-eeb0cde2fcbb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.312605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.313275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.313562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.313837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.314472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:02.315428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.316162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.326029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 468/920] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:02.326968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.381494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.395651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4d006-b293-430d-850d-63febe2686e0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.428568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.437923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.438915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.439386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.439926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.440728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.442361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.447138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b1acf-cfbd-466d-8da6-68d5e0fa1138 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:02.452752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:02.453821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:02.454675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:02.457476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 453/921] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:02.466147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.493021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.494533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.495275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.495693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.496987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:02.497772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.499389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.506413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 469/922] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:02.512460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.568491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abadd4-3678-45a8-8789-4673bcf51591 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.606153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.606761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.607040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.607306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.607950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:02.608370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.609976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.615290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 454/923] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:02.616112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.628342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d300029-5b55-4001-962e-26488d8696e1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.642835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.665103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.665720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.665998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.666271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.666939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.668336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.676490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.699974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 470/924] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:17:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:17:02.699974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.741915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025f1b-2b79-4011-a60e-feb8b1fa881b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.788764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.789553 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.789898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.790244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.802847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:02.808856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:02.809906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:02.811156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 455/925] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:02.816933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.835767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69f4d-90f8-4e8c-8ab9-1d296f3b843e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.887746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.888414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.888694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.888970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.889619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:02.889922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:02.891551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:02.897636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 471/926] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:02.903982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:02.942919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.960292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab654cfb-3f4a-47ac-bee1-5d5e47662b02 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:02.975889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:02.998052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:02.998663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:02.998944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:02.999218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:02.999883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:03.000212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.001573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065765e-00af-4cdf-9d7d-a4bf1a734bd7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.010479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 456/927] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:03.012650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d28b-ecf8-458b-ae93-3f38768baba0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.013412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d28b-ecf8-458b-ae93-3f38768baba0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.013889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829d28b-ecf8-458b-ae93-3f38768baba0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.015849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 457/928] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:03.016782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829d28b-ecf8-458b-ae93-3f38768baba0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.027538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee204c2-8ebd-406b-8acb-89c5c979c906 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.067810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.068755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.069110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.069384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.070093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] RBAC: Adding query filter params (interface=public, service_id=12d8867c665846a197b54fe6e263f605, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:03.070943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.072401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad7068-d12d-40a1-971f-93c380bb4046 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.077544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 472/929] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:17:02 2022] GET /identity/v3/endpoints?service_id=12d8867c665846a197b54fe6e263f605&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:03.083389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.083676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.083964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.103619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:03.104857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:03.125762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829d28b-ecf8-458b-ae93-3f38768baba0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.167409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.167996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.168281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.168559 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.183186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.184683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.192135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 473/930] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:03.192135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:03.208685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:03.209632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:03.210656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:03.210656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:03.210656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:03.210656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 458/931] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:03.216350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.239173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:03.265238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:03.321991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d3f3c-ae50-419c-adb9-9a640daeb0af None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.356211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e30b7-ed63-4979-8b35-db83446ea1bf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.373373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.374238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.374541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.374817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.375433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.377249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.386179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 474/932] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:17:03.399550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.400487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.400944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.401358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.402239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:03.402705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.404334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.420740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 459/933] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:03.428030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.495849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.536165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:03.547185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34011-355c-4c75-8b4c-4462b1915290 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.590820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.591817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.592148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.592246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.594887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:03.604518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.606564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.619270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f66af3-3a59-4185-8428-5290797860d4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:17:03.620778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:03.621686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:03.622604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 475/934] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:03.632651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.661121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.661908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.662205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.662484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.663082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.665685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:03.677349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:03.678315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:03.679238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 460/935] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:03.685027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.769198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7029d-1908-44f5-a358-f8c1af90eda2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.798173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d947-230d-418d-9bd7-d0482434576f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.815923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.816815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.817101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.817378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.818499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:03.818815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.820320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.837424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:03.838407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:03.838928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:03.839401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:03.840271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:03.840877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:03.842533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:03.844087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 476/936] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:03.848936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.853760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 461/937] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:03.859299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:03.868294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:03.876307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:03.968290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05da30a-2bbd-4e19-a1fb-c7c7b3b779bc None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:03.972312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a353bf-990d-42bd-8ee0-29231d2d1430 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:04.006355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.006968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.007240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.007510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.008681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:04.008980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.010329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.020062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.021162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.021659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.021846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 462/938] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:04.022359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.023145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:04.034204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.036181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:04.052855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:04.053813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:04.054785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:04.054785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:04.054785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:04.061829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 477/939] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:04.062997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:04.110470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:04.137007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:04.149257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff9a4-5f24-4523-94db-c087e6e61585 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:04.182561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea4dc4-2258-4538-ad92-f3e83769d14d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:04.204832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.206394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.206929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.207557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.208802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.210390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.227010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.227612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.227892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.228246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.228937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:04.229755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.230758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.242940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 463/940] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:17:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:17:04.248005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 478/941] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:04.249969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:04.377653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890830e-0499-4f0f-9688-32bd15223a1c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:04.410850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:04.417203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.417860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.418196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.418492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.426826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.428620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:17:04.441561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:04.442441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:04.443321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 464/942] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:04.450215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:04.569250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940540e1-5fd4-4230-b72f-93ac477e41c8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:04.595331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:04.611780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.612437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.612734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.613004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.613704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:04.614013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.615439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f041f-ff0d-4dcb-b89f-f5991b5437fa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.629088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 479/943] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:04.635492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:04.740746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc2ea4-2761-4dee-ae5e-aba60a320076 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:04.777499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aad072-1cd8-46d0-8a5b-ddb5b8f3f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:04.778609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad072-1cd8-46d0-8a5b-ddb5b8f3f356 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:04.779128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad072-1cd8-46d0-8a5b-ddb5b8f3f356 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:04.779643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad072-1cd8-46d0-8a5b-ddb5b8f3f356 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/57e9b176a3c148f79b4a406b74631713/roles/c2129d2d3f844d6da394d6c63024d994` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:04.782146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aad072-1cd8-46d0-8a5b-ddb5b8f3f356 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=57e9b176a3c148f79b4a406b74631713, role_id=c2129d2d3f844d6da394d6c63024d994)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:04.783895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aad072-1cd8-46d0-8a5b-ddb5b8f3f356 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:04.804474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 465/944] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:17:04 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/57e9b176a3c148f79b4a406b74631713/roles/c2129d2d3f844d6da394d6c63024d994 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:17:05.054888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2f39-2e65-4cb5-b260-2cd776cec36a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:05.055403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2f39-2e65-4cb5-b260-2cd776cec36a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:05.055481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d2f39-2e65-4cb5-b260-2cd776cec36a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:05.057328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 480/945] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:05.062842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:05.063134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:05.063418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:05.082686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:05.083890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:05.135012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:05.162307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 466/946] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:05.434861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2f39-2e65-4cb5-b260-2cd776cec36a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:05.552253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d2f39-2e65-4cb5-b260-2cd776cec36a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:05.589995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:05.590615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:05.590897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:05.591173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:05.591906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:05.593393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:05.596037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING keystone.server.flask.common [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 12:17:05.620616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.sql.core [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 12:17:05.620616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 12:17:05.620616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [parameters: {'id': '5781d94549d84424b13d898bb87e9ee8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 12:17:05.620616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81379) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-06f89319-c3ba-4d28-af80-278b50d2f75a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5781d94549d84424b13d898bb87e9ee8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5781d94549d84424b13d898bb87e9ee8. Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 12:17:05.637310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 22 12:17:05.638192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application yield resource Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise self.value Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application session.commit() Sep 22 12:17:05.639148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.flush() Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application compat.raise_( Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 12:17:05.640084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 12:17:05.641014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 12:17:05.642633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [parameters: {'id': '5781d94549d84424b13d898bb87e9ee8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:05.647655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:05.649735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5781d94549d84424b13d898bb87e9ee8. Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:05.651904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 481/947] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Sep 22 12:17:05 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:05.653216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:05.656978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1e8f3-0364-4191-916b-9195602e711f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:05.657372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1e8f3-0364-4191-916b-9195602e711f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:05.657652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1e8f3-0364-4191-916b-9195602e711f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:05.662834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 482/948] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:05.669367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:05.669646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:05.670231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:05.694312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:05.696305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:05.735045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:05.776542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273852-05de-4deb-92ac-76d44e8b88da None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:05.788037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 483/949] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:05.817530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:05.818854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:05.819379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:05.819837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:05.826813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:05.828536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:17:05.840630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:05.841532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:05.842426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:05.844386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 467/950] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:05.850388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:05.963840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165a91-1377-423b-8b6e-5f7761e47a8c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:05.999814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:06.000717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.001149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.001582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.002393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:06.002849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:06.004587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:06.022666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 484/951] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:06.094988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:06.142796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:06.209847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24bbd5-da44-46e0-9c5c-3e4ad0f93a96 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:06.244516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:06.245463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.245833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.246197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.246875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:06.248378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:06.257416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:06.259136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:06.260354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:06.263287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 468/952] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:06.266627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:06.299372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:06.378052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cd33e-b11a-40cc-9461-5e9269940573 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:06.414593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:06.415232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.415510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.415783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.416471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:06.416775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:06.418198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666f219-7a46-43d1-a772-def81eff7701 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:06.424282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 485/953] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:06.430347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:06.536211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37f68a-2308-49f3-8001-e044968af13b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:06.538909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:06.553499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0301-7d75-4534-bab5-b15f0c725aec None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.554229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0301-7d75-4534-bab5-b15f0c725aec None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.554752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b0301-7d75-4534-bab5-b15f0c725aec None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.556578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 486/954] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:06.561773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.562575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.562575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.578831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:06.579475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.579757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.580061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.580805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:06.581108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:06.581225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:06.582322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:06.582502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:06.592018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 469/955] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:06.595976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:06.669826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 487/956] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:06.714929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aadf8f-1d56-4815-84b1-3607257d1a26 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:06.749413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:06.750029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:06.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:06.750573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:06.751233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:06.752613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:06.774925 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 470/957] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:17:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:17:06.944327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:06.969771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:07.058365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06806d-6a14-4950-9502-f79f52f32e28 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:07.099133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:07.099820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.100123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.100387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] PATH_INFO: `/v3/services/compute` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.100959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:07.102821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-05ac30cd-4cc6-4d31-a0d9-f9266c0423ef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:07.111667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:07.112774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:07.113787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 488/958] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:07.121418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:07.132180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608a358-f2c7-4693-bb6b-d27f8a361332 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.132672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608a358-f2c7-4693-bb6b-d27f8a361332 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.133247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608a358-f2c7-4693-bb6b-d27f8a361332 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.135091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 489/959] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:07.140377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.140862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.141395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.148965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:07.167733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:07.169212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:07.256046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcbbcd-c72f-4b37-a842-7df29c883e34 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:07.271745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 490/960] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:07.299970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:07.299970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.299970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.299970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.300395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:07.300395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:07.301519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:07.307529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 471/961] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:07.312815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:07.340348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:07.416281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cfcc-74b0-4a03-9b11-5a2ad52b5a4d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:07.450336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:07.451001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.451206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.451479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.452191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:07.452486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:07.453884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:07.458713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 491/962] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:07.557894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:07.662041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:07.675992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121709e-deb9-4e03-b2c9-c91ce9bd89c4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:07.710687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:07.711821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.712125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.712395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.722794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:07.728197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:07.729189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:07.730024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 472/963] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 22 12:17:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:07.735714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:07.818326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:07.839692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b09d6-2575-482b-aafc-7fdd62014bcc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:07.874053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:07.874662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:07.874935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:07.875199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:07.875857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:07.876184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:07.877532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:07.886703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 492/964] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:17:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:07.892335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:07.999450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c8bc4-7416-40eb-9825-c0c2fd6c6762 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:08.036429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:08.037458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.037947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.038445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.049843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:08.051512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:08.060919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:08.068660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:08.069795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:08.071749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:08.071749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:08.071749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.074340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 473/965] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:08.079692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.182630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7adcf24-7589-4c6a-958d-2e7a1b4ff5b7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:08.222384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:08.223009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.223282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.223552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.224238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:08.224538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:08.226140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535befdb-1c37-4fda-b6d7-4697e3e85795 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:08.234378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:08.240997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 493/966] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:08.247711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.352685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183dcdb-1da5-4906-b7ec-b750dcab608a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.353177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183dcdb-1da5-4906-b7ec-b750dcab608a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.353177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183dcdb-1da5-4906-b7ec-b750dcab608a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.354734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 494/967] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:08.356059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab211-432b-4f16-aa45-e76260b02f8b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:08.359744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.360045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.360310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.378914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:08.380123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:08.395311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:08.396299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.396787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.397297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.405481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:08.407172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:17:08.418770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:08.419740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 12:17:08.420732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.423260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 474/968] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:17:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:08.435958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.457964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 495/969] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:08.496317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:08.542955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccb88-db3f-4aba-acf0-b8d98b5e9792 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:08.578469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:08.579188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.579476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.579751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.580515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:08.580823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:08.582255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:08.600689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 475/970] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 22 12:17:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:08.606518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.708127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9f658-1cee-40c1-9706-9158c641f2d6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:08.733854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.737361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:08.745686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:08.746306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.746581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.746853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.815866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:08.817349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:08.851290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831b2d-77a0-426b-8487-f96daf6d8485 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:08.872657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:08.894662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:08.895274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:08.895546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:08.895819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:08.896512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:08.899134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:08.902311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING keystone.server.flask.common [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 12:17:08.920120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.sql.core [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 12:17:08.920120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 12:17:08.920120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [parameters: {'user_id': 'ee9b4a965d4a45a5b33649c95a5cfcba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 12:17:08.920120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81380) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 12:17:08.926203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 496/971] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:17:08.933987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application conn.query(q) Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result.read() Sep 22 12:17:08.934182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 12:17:08.935033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application next(self.gen) Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application yield resource Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application next(self.gen) Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise self.value Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application session.commit() Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 12:17:08.936123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.session.flush() Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application compat.raise_( Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 12:17:08.937039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 12:17:08.944883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application conn.query(q) Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result.read() Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 12:17:08.947050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ee9b4a965d4a45a5b33649c95a5cfcba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:08.949361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 22 12:17:08.951336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 476/972] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 22 12:17:08 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:08.953627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:08.977973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.061762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9119d3-1127-4429-a025-4aac464935c9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.072957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f02ac-a4fd-4bcc-a5db-7e52e949da21 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.095759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.096420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.096699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.096972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.107267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.108727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.109924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.110813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.111301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.111722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.120056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.122073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8f4d7540-3c77-4610-b358-219a9f94f5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:09.123291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:09.124472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:09.125354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:09.125354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:09.125354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:09.125354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 497/973] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:09.125816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10faa4a-1c45-4aee-b980-4a37969f2f8c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.126097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10faa4a-1c45-4aee-b980-4a37969f2f8c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.126369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10faa4a-1c45-4aee-b980-4a37969f2f8c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.127771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 498/974] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:09.132405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10faa4a-1c45-4aee-b980-4a37969f2f8c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5dbeb5de-ab80-40f1-893d-874128911ebd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:17:09.140716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:09.141859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 12:17:09.143028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:09.149425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 477/975] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:09.149425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.149425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.149425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.166552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:09.168176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:09.207903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.224654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.244629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 478/976] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:09.245934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.254251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10faa4a-1c45-4aee-b980-4a37969f2f8c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.296766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.297541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.298322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.298699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.299721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:09.300155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.301898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.320093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 499/977] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:09.325230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.374445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd9176-f662-4ce5-ac1f-e3656cf3061a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.412947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.413791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.414285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.414719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.415568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:09.416174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.417846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.455158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169de5-7caa-4768-a74d-93d14b7bd53e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.464261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 479/978] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:09.496679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.497503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.497880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.498249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.506543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.508790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.511912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:17:09.522812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:09.525169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:09.527195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:09.531298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 500/979] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:09.532844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.534866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.578002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.648606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe01a25-c1ab-4860-a05f-5421306e5c43 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.680528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326f3e8-76dc-4c29-9f52-a4235039c55d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.691240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.692318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.692697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.693063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.693841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:09.694395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.697181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.713225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 501/980] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:09.719237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.723000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.724081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.724369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.724643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.725245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.726612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:09.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:09.737896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:09.739737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 480/981] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:09.744903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.804000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.853127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac73e0-34a5-47c6-a925-9ee42e2a67c0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.861200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:09.872467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5241763-ddc5-4b19-befc-4c53f328d88e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:09.890219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.890823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.891097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.891366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.892113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] RBAC: Adding query filter params (role.id=c2129d2d3f844d6da394d6c63024d994, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=57e9b176a3c148f79b4a406b74631713) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:09.892420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.893832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4322-a4f4-47ae-966f-7672085f8574 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.899679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 502/982] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/role_assignments?user.id=57e9b176a3c148f79b4a406b74631713&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=c2129d2d3f844d6da394d6c63024d994 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:09.901130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e37e-5ec1-4e65-bddb-7631602b5e2e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.901416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e37e-5ec1-4e65-bddb-7631602b5e2e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.901689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e37e-5ec1-4e65-bddb-7631602b5e2e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.902891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 503/983] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:09.908557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.908838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.909112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.912198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:09.913050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:09.913526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:09.913948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:09.914793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:09.915293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:09.916909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:09.922562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 481/984] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:09.928451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:09.928654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:09.929689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:10.012983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 504/985] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:10.041531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146569b-1ddc-4a7f-9bba-b5855ad1a17d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:10.079205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:10.079826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:10.080131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:10.080406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:10.081045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:10.081337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:10.082741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:10.088750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 482/986] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:10.094855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:10.152242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:10.204350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c1f9-bbd8-47a1-9ee0-0a5014cdb353 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:10.238529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:10.239132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:10.239404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:10.239666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:10.240396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] RBAC: Adding query filter params (interface=admin, service_id=12d8867c665846a197b54fe6e263f605, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:10.240700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:10.242040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:10.252507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 505/987] 10.222.0.25 () {56 vars in 1249 bytes} [Thu Sep 22 12:17:10 2022] GET /identity/v3/endpoints?service_id=12d8867c665846a197b54fe6e263f605&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:10.254048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:10.277275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:10.281081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:10.362452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8116121-af1c-428f-8522-713c8ed1837a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:10.392114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c6a9-549c-4e1f-ad76-750c1ca08d2d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:10.398146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29308b86-e39a-45de-a952-259afddd1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:10.399994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308b86-e39a-45de-a952-259afddd1f41 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:10.400231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308b86-e39a-45de-a952-259afddd1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:10.400510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308b86-e39a-45de-a952-259afddd1f41 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:10.401115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308b86-e39a-45de-a952-259afddd1f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:10.402542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308b86-e39a-45de-a952-259afddd1f41 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:10.410459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 483/988] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:17:10 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:17:10.419961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:10.433968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b498a4-33bf-4388-aebf-756ebb6d3718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:10.434701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b498a4-33bf-4388-aebf-756ebb6d3718 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:10.435070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b498a4-33bf-4388-aebf-756ebb6d3718 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:10.435415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b498a4-33bf-4388-aebf-756ebb6d3718 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:10.436195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b498a4-33bf-4388-aebf-756ebb6d3718 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:10.437664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b498a4-33bf-4388-aebf-756ebb6d3718 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:10.454498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 506/989] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:17:10 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:12.087145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a2f3-67ff-47ec-bc4f-c9454ff624e1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.087669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a2f3-67ff-47ec-bc4f-c9454ff624e1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.087669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a2f3-67ff-47ec-bc4f-c9454ff624e1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.089203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 484/990] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:12.094346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7bc8c-c8b5-440e-8290-513042b63393 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.094778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7bc8c-c8b5-440e-8290-513042b63393 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.094985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7bc8c-c8b5-440e-8290-513042b63393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.113643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d2d7bc8c-c8b5-440e-8290-513042b63393 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:12.114824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d2d7bc8c-c8b5-440e-8290-513042b63393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:12.190659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 507/991] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:12.457569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a2f3-67ff-47ec-bc4f-c9454ff624e1 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:12.551649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:12.572765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a2f3-67ff-47ec-bc4f-c9454ff624e1 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:12.572955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8b381-5af1-4570-808e-69e33bba4032 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.573074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8b381-5af1-4570-808e-69e33bba4032 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.573376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8b381-5af1-4570-808e-69e33bba4032 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.574728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 508/992] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:12.580199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f82f-7618-4ae5-8771-c29ea0a0735d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.580488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f82f-7618-4ae5-8771-c29ea0a0735d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.580760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f82f-7618-4ae5-8771-c29ea0a0735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.598877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-49d3f82f-7618-4ae5-8771-c29ea0a0735d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:12.600093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-49d3f82f-7618-4ae5-8771-c29ea0a0735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:12.610165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:12.610802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.611075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.611345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] PATH_INFO: `/v3/services/image` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.611953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:12.613308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:12.622452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:12.628572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:12.629455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 485/993] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 22 12:17:12 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:12.630255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:12.671118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 509/994] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:12.672395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8ccda-4c20-47d3-8e79-dc6fb3c034bd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.672675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8ccda-4c20-47d3-8e79-dc6fb3c034bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.672942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8ccda-4c20-47d3-8e79-dc6fb3c034bd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.674301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 510/995] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:12.679292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.679596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.679870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.697460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:12.698628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:12.725174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:12.734928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7e86b-bb22-4f0c-9c10-96ceb5f72e12 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:12.769394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:12.770007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.770288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.770561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.771188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] RBAC: Adding query filter params (name=image) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:12.771492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:12.772887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:12.776094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 511/996] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:12.779985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 486/997] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:12.783527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:12.891339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28e60-9212-4195-bd68-2a873f87e543 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:12.937049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:12.938105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:12.938439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:12.938739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:12.939089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:12.939360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] RBAC: Adding query filter params (type=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:12.939654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:12.941094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:12.955107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 512/998] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:12.955359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.044324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.055667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196496e-2a8f-457d-ba12-880b4975e144 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.075751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.097383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.098107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.098387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.098654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.099235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.100657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:13.110240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:13.112155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:13.113140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 487/999] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 22 12:17:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:13.118250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.160903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4d8fd-47dd-49db-81b9-b9e80597e660 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.194963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.196164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.196446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.196715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.197303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.199967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:13.208702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:13.209717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:13.210563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 513/1000] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:13.212771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.217498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.247596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5a47e-7912-482a-8c4d-0648869033e4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.295017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.295557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.295835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.296135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.296770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:13.297072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.298861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.303797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 488/1001] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:13.309698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.321226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.330674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf43cd-c7e1-45ec-8ea2-4039ff369aa3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.365667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.366276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.366550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.366819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.367955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:13.368250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.369601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.379277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 514/1002] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:13.380145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.417566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae6b23-bf6a-42d7-87ca-a6010a36ce68 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.455243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.455855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.456173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.456445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.457066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:13.457365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.458891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.464240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 489/1003] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:13.469605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.473119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.489370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94293638-f5cf-45ca-8843-fc766e7ccb47 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.526351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.527093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.527302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.527577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.528241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:13.528661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.529894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.534960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 515/1004] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:13.540514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.563440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.579728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91fa0-8533-49cb-9221-cf0c242464b6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.615616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.616265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.616546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.616822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.618008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.619381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.636645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 490/1005] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:17:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:13.661071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862851e-3083-4059-8a61-8c120ba80998 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.706385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.707005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.707279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.707545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.708290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] RBAC: Adding query filter params (interface=public, service_id=86e17c14de304501b3f630b4e09853bd, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:13.708594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.709978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0bb89-d848-40e8-b8cb-93f291c12685 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.716094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 516/1006] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/endpoints?service_id=86e17c14de304501b3f630b4e09853bd&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:13.721650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:13.787852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:13.831732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ebcf3-d9d3-461b-b7ed-315994e1bbef None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:13.869809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e549128-c95f-493a-8dda-b74dcff7d553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:13.870687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e549128-c95f-493a-8dda-b74dcff7d553 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:13.870963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e549128-c95f-493a-8dda-b74dcff7d553 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:13.871232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e549128-c95f-493a-8dda-b74dcff7d553 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:13.871884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e549128-c95f-493a-8dda-b74dcff7d553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:13.873303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e549128-c95f-493a-8dda-b74dcff7d553 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:13.879594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 491/1007] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:17:13 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:17:15.122614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a77261-c746-433a-b661-bd6e160f6996 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:15.123171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a77261-c746-433a-b661-bd6e160f6996 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:15.123171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a77261-c746-433a-b661-bd6e160f6996 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:15.124751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 517/1008] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:15.129957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9f9d-c065-40d9-887f-162a6c6e3820 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:15.130357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9f9d-c065-40d9-887f-162a6c6e3820 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:15.130518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a9f9d-c065-40d9-887f-162a6c6e3820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:15.148547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fc8a9f9d-c065-40d9-887f-162a6c6e3820 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:15.150236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fc8a9f9d-c065-40d9-887f-162a6c6e3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:15.226158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 492/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:15 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:15.491653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a77261-c746-433a-b661-bd6e160f6996 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:15.585538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:15.608082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a77261-c746-433a-b661-bd6e160f6996 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:15.643033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b51e01-cff4-4a6c-a031-8e78fa760f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:15.643645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51e01-cff4-4a6c-a031-8e78fa760f64 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:15.643925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51e01-cff4-4a6c-a031-8e78fa760f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:15.644256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b51e01-cff4-4a6c-a031-8e78fa760f64 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:15.645011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51e01-cff4-4a6c-a031-8e78fa760f64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:15.646383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b51e01-cff4-4a6c-a031-8e78fa760f64 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:15.664001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 518/1010] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:17:15 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:15.846110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012ef51-0b28-4c2e-861b-927094bcaa5f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:15.846304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012ef51-0b28-4c2e-861b-927094bcaa5f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:15.846576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012ef51-0b28-4c2e-861b-927094bcaa5f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:15.848003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 493/1011] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:15.853747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a75f-a859-4909-bbd8-a6f72a3a4c5a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:15.854028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a75f-a859-4909-bbd8-a6f72a3a4c5a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:15.854296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a75f-a859-4909-bbd8-a6f72a3a4c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:15.873759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2a52a75f-a859-4909-bbd8-a6f72a3a4c5a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:15.874934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2a52a75f-a859-4909-bbd8-a6f72a3a4c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:15.956290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 519/1012] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:16.035916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926390-fae0-4944-bab1-9e09f975c5fd None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.036228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926390-fae0-4944-bab1-9e09f975c5fd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.036506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926390-fae0-4944-bab1-9e09f975c5fd None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.037851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 494/1013] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:16.043663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.043969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.044246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.063009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:16.064224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:16.123359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:16.132822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 520/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:16.229292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926390-fae0-4944-bab1-9e09f975c5fd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:16.287687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:16.330356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926390-fae0-4944-bab1-9e09f975c5fd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:16.364109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:16.364739 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.365014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.365282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.366377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:16.367827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:16.369630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 495/1015] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:16.375583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:16.402460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:16.482014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a1348-6c43-406f-b4c8-496957c1974c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:16.512375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e8149-07b8-4c28-a167-c12d5385d864 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:16.516677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:16.517282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.517556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.517821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.518461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:16.519870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:16.540105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:16.550253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 521/1016] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:17:16 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:16.550545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:16.551183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.551459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.551730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.552348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:16.553775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:16.564046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:16.565255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 12:17:16.566409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:16.568828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 496/1017] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:16.575415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:16.631916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:16.693062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2fa00-e2ce-4889-a144-3479b7a3f7f9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:16.730096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:16.730465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.730634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.730888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.732302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:16.732302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:16.733232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:16.738172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 522/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:16.743816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:16.848710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f0dd-a975-4e6e-92fa-28e652ea92fe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:16.883541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:16.884106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:16.884386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:16.884658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:16.885280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:16.885582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:16.886952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55957adb-be5d-4f17-aedd-da9e3e57714b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:16.892078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 497/1019] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 22 12:17:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:16.897362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:17.000146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4756975-496f-4b74-88c0-8da503b5bdc7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:17.013337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:17.035726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425e3a0-ab10-48b2-9c06-06da201709f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:17.036369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425e3a0-ab10-48b2-9c06-06da201709f0 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:17.036651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425e3a0-ab10-48b2-9c06-06da201709f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:17.036923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425e3a0-ab10-48b2-9c06-06da201709f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:17.037593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425e3a0-ab10-48b2-9c06-06da201709f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:17.038955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425e3a0-ab10-48b2-9c06-06da201709f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:17.063970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 523/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:17:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:17.857096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e066d9-2730-44cf-9b4e-31e3e2aa0d8d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:17.857682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e066d9-2730-44cf-9b4e-31e3e2aa0d8d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:17.857682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e066d9-2730-44cf-9b4e-31e3e2aa0d8d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:17.858976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 498/1021] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:17.864484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:17.864919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:17.865017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:17.883708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:17.884949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:17.963996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 524/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:18.228151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e066d9-2730-44cf-9b4e-31e3e2aa0d8d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:18.286251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:18.336029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e066d9-2730-44cf-9b4e-31e3e2aa0d8d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:18.371438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:18.372112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:18.372376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:18.372652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:18.373235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:18.374658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:18.383767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:18.384830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:18.385672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 499/1023] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 22 12:17:18 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:18.392556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:18.486931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:18.495424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1204f-1a48-4aa7-a1e3-6785fd334f24 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:18.529408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:18.530019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:18.530298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:18.530568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:18.531195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:18.531503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:18.532883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:18.542846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 525/1024] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:18.544073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:18.654229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2a5ea-6c0e-4533-b761-7082999b61a5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:18.680989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:18.700751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:18.701361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:18.701638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:18.701909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:18.702532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:18.702833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:18.704214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712c3ed-07b1-455c-bb97-ce505b76b9c2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:18.714378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 500/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:18.715983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:18.757634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ed53d-b4b3-4e55-9670-059ffb3d1ee7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:18.757843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ed53d-b4b3-4e55-9670-059ffb3d1ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:18.758143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ed53d-b4b3-4e55-9670-059ffb3d1ee7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:18.759475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 501/1026] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:18.764619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2653-72d0-4448-9163-670d0792209a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:18.764912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2653-72d0-4448-9163-670d0792209a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:18.765191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2653-72d0-4448-9163-670d0792209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:18.784591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2eda2653-72d0-4448-9163-670d0792209a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:18.785801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2eda2653-72d0-4448-9163-670d0792209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:18.825789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76b15-eac1-4773-a469-5cc221b239c8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:18.855547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 502/1027] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:18.862683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:18.863293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:18.863566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:18.863839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:18.864564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] RBAC: Adding query filter params (interface=public, service_id=7f4344c9288c45cda6fdf288c77f397c, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:18.865094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:18.866193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:18.876165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 526/1028] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:17:18 2022] GET /identity/v3/endpoints?service_id=7f4344c9288c45cda6fdf288c77f397c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:18.877738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2653-72d0-4448-9163-670d0792209a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:18.979505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda2653-72d0-4448-9163-670d0792209a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:18.993074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:19.016586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:19.017125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:19.017410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:19.017684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:19.018287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:19.019642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:19.032171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 503/1029] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:17:18 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:17:19.126805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:19.155413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:19.247236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cd112-479e-4d4d-b1b7-af9f35ae7675 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:19.282899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae64be-18b1-44a8-946b-eed04b563885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:19.283444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae64be-18b1-44a8-946b-eed04b563885 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:19.283719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae64be-18b1-44a8-946b-eed04b563885 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:19.284015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae64be-18b1-44a8-946b-eed04b563885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:19.285114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae64be-18b1-44a8-946b-eed04b563885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:19.286544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae64be-18b1-44a8-946b-eed04b563885 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:19.288299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 527/1030] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:19.294059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:19.347538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6518cd-44de-41c6-8106-f88ec8f26040 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:19.347859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6518cd-44de-41c6-8106-f88ec8f26040 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:19.348130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6518cd-44de-41c6-8106-f88ec8f26040 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:19.349462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 528/1031] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:19.354884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:19.355428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:19.355699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:19.377704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:19.378886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:19.398967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977d49f-8c93-497f-bee4-6474ae9faa37 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:19.434545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:19.435153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:19.435432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:19.435706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:19.436394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:19.437862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:19.452583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 529/1032] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:19.463536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 504/1033] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:17:19 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:19.722581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:19.744520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:19.826560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164d194-0770-45f5-88aa-dfd684c99dce None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:19.860982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:19.861619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:19.861896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:19.862164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:19.873224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:19.878049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:19.878988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:19.879873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 530/1034] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 22 12:17:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:19.885944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:19.919369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:19.997517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b4716-fd83-4021-97a2-b69590dd8081 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:20.030330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:20.030939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:20.031215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:20.031487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:20.032175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:20.032480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:20.033837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:20.046812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 505/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:17:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:20.048580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:20.129573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:20.149730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0990c8-e1ed-482d-8af9-5045331ff24a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:20.183288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:20.183913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:20.184216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:20.184486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:20.202840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:20.202840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:20.218415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:20.219360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:20.220275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:20.220275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:20.220275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:20.221007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 531/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:20.225265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:20.330564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:20.338773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbe936-b495-4e22-98be-b83f06c68396 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:20.373943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:20.374605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:20.374879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:20.375154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:20.375853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:20.376189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:20.377584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:20.389522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 506/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:20.394992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:20.500474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68f99-9703-477a-9143-3ee66fb7824d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:20.529380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:20.535305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:20.536322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:20.537004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:20.537283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:20.544641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:20.546076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:17:20.557136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:20.558086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:20.559027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 532/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:17:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:20.565588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:20.672967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb645-3859-43df-9ed7-dc0c66d12aae None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:20.707523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:20.708162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:20.708444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:20.708714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:20.709432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:20.709738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:20.711147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:20.733113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 507/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:17:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:20.734629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:20.835244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ecbd2-900f-4023-aabe-d3b5fa551ad0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:20.869764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4376c3e-d77e-4627-a6e8-fdfc9f94aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:20.870373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376c3e-d77e-4627-a6e8-fdfc9f94aa9f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:20.870656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376c3e-d77e-4627-a6e8-fdfc9f94aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:20.871193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376c3e-d77e-4627-a6e8-fdfc9f94aa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:20.928588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:20.940302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4376c3e-d77e-4627-a6e8-fdfc9f94aa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:20.941756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4376c3e-d77e-4627-a6e8-fdfc9f94aa9f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.043005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 533/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 12:17:21.044506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.059710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:21.150335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2059-3d32-4360-98db-0e47034c5eff None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.184242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.184796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.185076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.185350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.204227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.205717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.208635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab277bc-18a4-4904-a104-c57e9eaa7e52 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.208922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab277bc-18a4-4904-a104-c57e9eaa7e52 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.209198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab277bc-18a4-4904-a104-c57e9eaa7e52 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.210680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 534/1041] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:21.215395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.215668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.215948 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:21.221639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:21.222561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:21.229060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:21.229060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:21.229060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:21.229060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 508/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:21.229060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.241890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:21.243780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:21.299584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:21.314921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 535/1043] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:21.341184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907ad22-11c8-4e6d-8012-f87ce7364ff8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.376833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.377703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.378195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.378691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.379511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:21.380037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.381578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.394091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 509/1044] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:21.399556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.424405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:21.502632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ae51-9e24-40df-81c3-cc3591fb370a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.535766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.536489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.536775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.537045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.544174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.545604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:17:21.557504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:21.558373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:21.559277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:21.563501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 536/1045] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:21.564754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.587794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.677839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:21.687069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e9da-91aa-4d76-9656-19790cb1de77 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.697412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0409fa8-8712-4f8b-8a54-476648e5086f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.712954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:21.723771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.724408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.724689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.724961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.725645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:21.725956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.727970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a1af0-8391-4f97-9fcb-7dc1da5db8de None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.731485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.732144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.732418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.732683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] PATH_INFO: `/v3/services/image` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.733254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.734688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.739105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 510/1046] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:21.740380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5afa5d-9612-4baf-af5b-7fa16038fb25 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.740666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5afa5d-9612-4baf-af5b-7fa16038fb25 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.740941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5afa5d-9612-4baf-af5b-7fa16038fb25 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.742286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 511/1047] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ac9daede-f231-4a86-b4b0-3e2517095e6f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:21.743364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:21.748207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:21.749103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 537/1048] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:21.750181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5afa5d-9612-4baf-af5b-7fa16038fb25 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.750255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.750255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.750255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.765185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:21.766288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:21.831377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 538/1049] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:21.832033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:21.850909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5afa5d-9612-4baf-af5b-7fa16038fb25 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.889253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.889856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.890144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.890416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.891166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] RBAC: Adding query filter params (role.id=c2129d2d3f844d6da394d6c63024d994, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=d671292a536e4a61931f1127f63c2883) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:21.891476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.892936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:21.899310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 512/1050] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/role_assignments?user.id=d671292a536e4a61931f1127f63c2883&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=c2129d2d3f844d6da394d6c63024d994 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:21.927472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:21.954300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dd748-50aa-4aa8-8c80-cc80b3be7b1d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:21.991820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:21.992531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:21.992813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:21.993086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:21.993730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] RBAC: Adding query filter params (name=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:21.994032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:21.995412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:22.004277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 539/1051] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:22.007105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.061064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:22.098864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.118882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961db0-f567-4f9b-a431-ae11f2875f70 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:22.156019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:22.156633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:22.156916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:22.157188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:22.157854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] RBAC: Adding query filter params (type=image) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:22.158167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:22.159539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:22.169680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 513/1052] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:22.170317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.208970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce11a0-09ce-457f-a755-2905893cc6ea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:22.246269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:22.246907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:22.247184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:22.247449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:22.255791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:22.259966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:22.264939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:22.265870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:22.266718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:22.274607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 540/1053] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:22.275636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.292008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47d38c-3dd2-4cc4-ab83-3c4ee83b5840 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:22.306307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:22.330667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:22.331275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:22.331482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:22.331755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:22.332451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:22.333810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:22.355909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 514/1054] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:17:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:22.391790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349eab5-d876-4a05-99f5-97664f4e20ed None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:22.436625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:22.437242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:22.437513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:22.437774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:22.438439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:22.438732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:22.440116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:22.455919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 541/1055] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:22.457482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.564376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ce543-3e6b-49a4-8b36-fffa62db36c2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:22.599984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:22.600534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:22.600809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:22.601075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] PATH_INFO: `/v3/users/26e6fd41c0c840b3b622d9ca0b812ff4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:22.614385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] RBAC: Authorizing `identity:get_user(user_id=26e6fd41c0c840b3b622d9ca0b812ff4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:22.615822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:22.618175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 515/1056] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:22 2022] GET /identity/v3/users/26e6fd41c0c840b3b622d9ca0b812ff4 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:22.624315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.682339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:22.723769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2d76d-2c20-49a1-bdba-2cd5699425e8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:22.758315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:22.758902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:22.759179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:22.759446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:22.827300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:22.828757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:22.886055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:22.934272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 542/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 12:17:22.935542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:22.963289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:23.046956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca549263-305a-4537-9a80-a73d57dab0cf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:23.080956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3dcb5-1381-4f23-9e93-8db9b1b77748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:23.081575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3dcb5-1381-4f23-9e93-8db9b1b77748 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:23.081855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3dcb5-1381-4f23-9e93-8db9b1b77748 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:23.082126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3dcb5-1381-4f23-9e93-8db9b1b77748 None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:23.083244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3dcb5-1381-4f23-9e93-8db9b1b77748 None admin] RBAC: Authorizing `identity:get_project(project_id=1c428b776ce84c8098d480f28d0ab916)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:23.084707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3dcb5-1381-4f23-9e93-8db9b1b77748 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:23.091859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 516/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:22 2022] GET /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:23.093045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:23.191183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc36ba-3052-4665-b1b4-6c7f46e70aec None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:23.232572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:23.233179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:23.233454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:23.233721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:23.234436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=1c428b776ce84c8098d480f28d0ab916, user.id=26e6fd41c0c840b3b622d9ca0b812ff4) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:23.234740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:23.236189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15420be-e765-44d8-8e87-1d95d9f9b73a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:23.247975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 543/1059] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:23 2022] GET /identity/v3/role_assignments?user.id=26e6fd41c0c840b3b622d9ca0b812ff4&scope.project.id=1c428b776ce84c8098d480f28d0ab916&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:24.032269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e56d-f9b0-441b-98ca-beba67e19c3c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.032606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e56d-f9b0-441b-98ca-beba67e19c3c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.032814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e56d-f9b0-441b-98ca-beba67e19c3c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.034309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 517/1060] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:24.039227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228130c-5a5e-4690-89bb-0b74e1c8cc95 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.040110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228130c-5a5e-4690-89bb-0b74e1c8cc95 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.040381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228130c-5a5e-4690-89bb-0b74e1c8cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.058389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3228130c-5a5e-4690-89bb-0b74e1c8cc95 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:24.059633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3228130c-5a5e-4690-89bb-0b74e1c8cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:24.076061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:24.129736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 544/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:24.400364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198e56d-f9b0-441b-98ca-beba67e19c3c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:24.498244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:24.506875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198e56d-f9b0-441b-98ca-beba67e19c3c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:24.542502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:24.543135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.543411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.543680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.553232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931f1f-9da7-4710-aa7d-04799fee00e2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.553518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931f1f-9da7-4710-aa7d-04799fee00e2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.553734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:24.553845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931f1f-9da7-4710-aa7d-04799fee00e2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.555189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 545/1062] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:24.558594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:24.559520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:24.560719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:24.561390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.561390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.561390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.564078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 518/1063] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 22 12:17:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:24.565348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:24.579283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:24.580766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:24.664153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 546/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:24.669201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c14600-40f6-47df-b45c-155e8dff6094 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:24.703049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:24.703654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.703964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.704228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.704886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:24.705188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:24.706544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:24.718815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 519/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:17:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:24.720029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:24.800679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:24.820198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777b871-b343-47f9-bc2f-ffe48511000e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:24.855249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:24.855878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:24.856195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:24.856468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:24.866848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:24.868871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:24.884311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:24.885237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:24.891283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:24.891283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:24.891283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:24.891283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 547/1066] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:24.891511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:24.910100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:24.924619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:24.998535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6334fe8-26c6-45bd-b03f-cd98b2f0f0fd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.028161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd0b0c-3e53-4793-83ce-5ff0963398ff None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.032533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.033149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.033429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.033702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.034341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:25.034645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.036210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.052886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 520/1067] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:25.053926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.068432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.069047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.069331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.069609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.072332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.139206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.140414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.142191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.170628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650f97-7bbc-4377-86df-f1d03060eea9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.213399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.214041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.214320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.214594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.221763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.223533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:17:25.236037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:25.237007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:25.237934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 521/1068] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:25.243560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.250389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 548/1069] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 12:17:25.256314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.294253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.353730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aafa56-24f0-4fee-b8b3-399c1b62147a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.367524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f2bd1-e97e-43a4-bb4f-86d81bcbe9c1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.387694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.388403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.388685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.388958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.389678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:25.389987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.391403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182d87d-3212-4380-ae06-2ec2a116e522 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.393896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.401218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.401845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.402120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.402389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.409400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 522/1070] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:25.410612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1a9a-45f3-4112-960f-4e0c37528540 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.410870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1a9a-45f3-4112-960f-4e0c37528540 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.411144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b1a9a-45f3-4112-960f-4e0c37528540 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.412370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 523/1071] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:25.414219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.417843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.418271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.418547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.418812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:25.432297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:25.433382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:25.434263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:25.434263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:25.434263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:25.434263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 549/1072] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:25.434263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.436320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:25.437507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:25.503058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 524/1073] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:17:25.503887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.522925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.540039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e53a17-95ab-4f96-859f-e55af976e756 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.574488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.575182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.575469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.575743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.587335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.588803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:25.604448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:25.605511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:25.606626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:25.606626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:25.606626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:25.606626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 550/1074] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:25.612301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c07b-f766-47a4-9f92-be32f1da21a6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.612797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.636816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.648519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.649659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.649942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.650220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.651088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:25.651196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.652544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.665247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 525/1075] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:25.721555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e3644-ab65-4648-bb21-55ab078170b6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.758830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.759367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.759643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.759912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.760600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:25.760901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.762279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.770501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:25.770999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.779096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 551/1076] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:25.784493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.884820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85cc4-f532-4e65-833d-19d2f31b4804 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.909975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393542e-7b90-4a93-af2b-97854ce32d6b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:25.927091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.927728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.928035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.928329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.944223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:25.948620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:25.949259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:25.949472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:25.950353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:25.951197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:25.951829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:25.951829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:25.952015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 526/1077] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:25.956683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:25.959987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:25.962105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:17:25.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:25.974758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:25.975653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 552/1078] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:25.981397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:26.011552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:26.039644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:26.065294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bed34-e4af-4af9-ad60-0a95758ec738 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:26.080791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d4ddb-a16b-4452-a25b-37aa16ace5bb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:26.097903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:26.098506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:26.098788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:26.099064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:26.099732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:26.100069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:26.101446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:26.109850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 527/1079] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:26.113916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:26.114603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:26.114882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:26.115155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:26.115685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:26.115847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:26.116180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:26.118115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:26.130222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 553/1080] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:26.136576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:26.213490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8953-ec73-411f-9943-09b0c2c44454 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:26.220636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:26.238420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8f88-b76b-477a-960d-52378156f0ba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:26.248455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:26.249086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:26.249369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:26.249649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] PATH_INFO: `/v3/users/26e6fd41c0c840b3b622d9ca0b812ff4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:26.250783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] RBAC: Authorizing `identity:get_user(user_id=26e6fd41c0c840b3b622d9ca0b812ff4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:26.252236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:26.253820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 528/1081] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:26 2022] GET /identity/v3/users/26e6fd41c0c840b3b622d9ca0b812ff4 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:26.258141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:26.260345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:26.275564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:26.276305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:26.276587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:26.276862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/d671292a536e4a61931f1127f63c2883/roles/c2129d2d3f844d6da394d6c63024d994` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:26.279037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=d671292a536e4a61931f1127f63c2883, role_id=c2129d2d3f844d6da394d6c63024d994)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:26.280510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:26.293394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 554/1082] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:17:26 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/d671292a536e4a61931f1127f63c2883/roles/c2129d2d3f844d6da394d6c63024d994 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:17:26.361654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6375-de02-48e5-829a-a8d515247a2a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:26.399416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658aee9-71b2-4882-8a9b-509aaceed443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:26.400093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658aee9-71b2-4882-8a9b-509aaceed443 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:26.400370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658aee9-71b2-4882-8a9b-509aaceed443 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:26.400640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658aee9-71b2-4882-8a9b-509aaceed443 None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:26.401770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658aee9-71b2-4882-8a9b-509aaceed443 None admin] RBAC: Authorizing `identity:get_project(project_id=1c428b776ce84c8098d480f28d0ab916)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:26.403208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658aee9-71b2-4882-8a9b-509aaceed443 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:26.404928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 529/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:26 2022] GET /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:26.411066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:26.513634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f215ba-1fba-49f6-b2eb-2e043474f542 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:26.546404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07933d-a2f9-45c8-ba6c-4e05652e30b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:26.546987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07933d-a2f9-45c8-ba6c-4e05652e30b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:26.547264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07933d-a2f9-45c8-ba6c-4e05652e30b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:26.547535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07933d-a2f9-45c8-ba6c-4e05652e30b6 None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916/users/26e6fd41c0c840b3b622d9ca0b812ff4/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:26.549450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07933d-a2f9-45c8-ba6c-4e05652e30b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c428b776ce84c8098d480f28d0ab916, user_id=26e6fd41c0c840b3b622d9ca0b812ff4, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:26.550875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07933d-a2f9-45c8-ba6c-4e05652e30b6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:26.564190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 555/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:17:26 2022] PUT /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916/users/26e6fd41c0c840b3b622d9ca0b812ff4/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:17:28.459494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90c86-c10c-4978-9877-968c9e720025 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:28.462398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90c86-c10c-4978-9877-968c9e720025 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:28.462398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90c86-c10c-4978-9877-968c9e720025 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:28.462398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 530/1085] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:28.467228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df3f6-6e7e-454d-a55e-e627837b1c4e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:28.467648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df3f6-6e7e-454d-a55e-e627837b1c4e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:28.467756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df3f6-6e7e-454d-a55e-e627837b1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:28.486174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9f6df3f6-6e7e-454d-a55e-e627837b1c4e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:28.487348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9f6df3f6-6e7e-454d-a55e-e627837b1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:28.515980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:28.553818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 556/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:28.708353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8ac8-6ecb-4c2b-b165-06f6427c87a7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:28.708655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8ac8-6ecb-4c2b-b165-06f6427c87a7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:28.708889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e8ac8-6ecb-4c2b-b165-06f6427c87a7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:28.710505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 531/1087] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:28.716355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:28.716645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:28.716923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:28.736959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:28.738138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:28.802139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 557/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:28.824775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e8ac8-6ecb-4c2b-b165-06f6427c87a7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:28.870930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:28.929115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e8ac8-6ecb-4c2b-b165-06f6427c87a7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:28.962212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:28.962775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:28.963054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:28.963326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:28.973058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:28.978063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:28.979226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:28.980182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 532/1089] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 22 12:17:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:28.985357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.071603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.078123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.081817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd235-13df-46f7-b25f-ba8c6ad5cb1b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.116229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.116837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.117109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.117373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.118510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:29.118802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.120159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.127957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 558/1090] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:17:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:29.134350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.170120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb38f33-e280-4902-a59e-8a888cf24e39 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.171616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.207766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.208434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.208715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.208991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.221849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:29.226622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:29.227692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:29.228580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 533/1091] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:29.233567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.236831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0a2a2-5df0-4aad-bd41-189cb83d484a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.270448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.271071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.271351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.271623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.281870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.283302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:29.297066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:29.298192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:29.299104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:29.299104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:29.299104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:29.299104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 559/1092] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:29.303979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.318558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.332852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89b6f2-ea86-47a1-ae8c-fb1b2dcb1920 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.365239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.365838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.366120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.366396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.367056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:29.367360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.369280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.377640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 534/1093] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:29.384084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.404459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7c550-5c69-4651-b7ad-4ce7cde84864 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.408627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.437930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.438541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.438826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.439096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.439731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:29.440063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.441414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.453391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 560/1094] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:29.459311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.483198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa544-4bf2-4fb2-bcbd-9f69d5d5e96f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.515672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.516320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.516596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.516867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] PATH_INFO: `/v3/users/26e6fd41c0c840b3b622d9ca0b812ff4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.517973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] RBAC: Authorizing `identity:get_user(user_id=26e6fd41c0c840b3b622d9ca0b812ff4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.519389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.520980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 535/1095] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/users/26e6fd41c0c840b3b622d9ca0b812ff4 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:29.526608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.529249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.559693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719c79-ef74-4d93-9df3-686e4ea001bd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.592256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.592879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.593788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.593788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.600375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.601798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:17:29.614241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:29.615247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 12:17:29.616352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:29.616953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.617027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 561/1096] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:29.621820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658a031-c53f-47e7-9aa5-1645e8bd9965 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.661587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.662191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.662471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.662745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.718724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89a99-c8f9-4109-b710-ddfca34c816a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.728023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.729461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.749313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.756138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.756852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.757134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.757415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.760024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:29.760024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.760024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.777298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 562/1097] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:29.783089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.823467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.833247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 536/1098] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 12:17:29.839463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.882106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c189-03a4-4904-a628-8b6a8e0b5c70 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.915664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.916288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.916563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.916944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.934865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ec4d-3efe-4823-8a3b-5043f7a2c1e5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:29.969720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:29.970342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:29.970624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:29.970907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:29.972049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] RBAC: Authorizing `identity:get_project(project_id=1c428b776ce84c8098d480f28d0ab916)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.973116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:29.973761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:29.975519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 537/1099] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:29.981728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:29.988648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:29.990093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.042136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:30.085969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1ee18-e9da-423b-a24c-0f2f232c729b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:30.089154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 563/1100] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 12:17:30.094641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:30.119381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:30.120009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:30.120292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:30.120560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:30.121532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=1c428b776ce84c8098d480f28d0ab916, user.id=26e6fd41c0c840b3b622d9ca0b812ff4) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:30.121834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:30.123233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.129069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 538/1101] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:29 2022] GET /identity/v3/role_assignments?user.id=26e6fd41c0c840b3b622d9ca0b812ff4&scope.project.id=1c428b776ce84c8098d480f28d0ab916&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:30.190170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:30.203629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50343aaa-3f5a-4c42-abba-edc819cd502a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:30.242403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:30.243100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:30.243380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:30.243652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:30.255065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:30.256564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:17:30.272551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:30.273568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:17:30.275083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:17:30.275083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:17:30.275083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:30.275083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 564/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:17:30.280150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:30.383756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2737749-1458-4d1a-9049-00aa6937a48b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:30.406606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:30.418058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:30.418663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:30.418941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:30.419211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:30.419847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:30.420204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:30.421555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.433109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 539/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:30.438690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:30.536326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8721b50-2d3b-43f8-9fa3-ea0a0ce41df5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:30.567803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:30.568528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:30.568804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:30.569079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:30.576472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:30.577897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:17:30.589401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:30.590351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:30.591329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 565/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:30.596478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:30.692714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee998-9198-4ef9-a0ba-2a601a84c8e3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:30.730076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:30.730684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:30.730965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:30.731240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:30.731941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:30.732283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:30.733706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428c83a-b427-4b0f-8d89-672a3e5cd840 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.745685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 540/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:17:30.752051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:30.754899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:30.848852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5759-71ea-4ad6-add1-5481eaf666f5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:30.881534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:30.882139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:30.882413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:30.882679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:30.884036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] RBAC: Adding query filter params (role.id=c2129d2d3f844d6da394d6c63024d994, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=d671292a536e4a61931f1127f63c2883) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:30.884344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:30.885764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40b21-b72e-4192-b6f1-88ad7b85ec6b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:30.891466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 566/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:30 2022] GET /identity/v3/role_assignments?user.id=d671292a536e4a61931f1127f63c2883&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=c2129d2d3f844d6da394d6c63024d994 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:32.325556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3d1a8-7b62-4a61-9fb6-966fb16ac31a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:32.326102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3d1a8-7b62-4a61-9fb6-966fb16ac31a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:32.326102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3d1a8-7b62-4a61-9fb6-966fb16ac31a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:32.327412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 541/1107] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:17:32.332578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:32.332992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:32.333132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:32.350937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:32.352154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:32.409763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:32.417615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 567/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:32.687811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3d1a8-7b62-4a61-9fb6-966fb16ac31a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:32.732599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:32.784984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3d1a8-7b62-4a61-9fb6-966fb16ac31a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:32.816867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75a6b6-7a18-4866-888d-5ab62d8b5de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:32.817473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a6b6-7a18-4866-888d-5ab62d8b5de4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:32.817748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a6b6-7a18-4866-888d-5ab62d8b5de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:32.818014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a6b6-7a18-4866-888d-5ab62d8b5de4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:32.819095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75a6b6-7a18-4866-888d-5ab62d8b5de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:32.820537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75a6b6-7a18-4866-888d-5ab62d8b5de4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:32.822088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 542/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:32.827561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:32.925920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870e84c-66bd-4e1c-8efc-e02605a431a6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:32.957796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0c743-e335-45cc-bfcd-09903a7d0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:32.958340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c743-e335-45cc-bfcd-09903a7d0f77 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:32.958621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c743-e335-45cc-bfcd-09903a7d0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:32.958895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c743-e335-45cc-bfcd-09903a7d0f77 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:32.959537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0c743-e335-45cc-bfcd-09903a7d0f77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:32.960988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0c743-e335-45cc-bfcd-09903a7d0f77 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:32.982560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 568/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:17:32 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:35.174040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94daa5-92ac-409b-858c-21df2030d7b1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:35.174595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94daa5-92ac-409b-858c-21df2030d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:35.174595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94daa5-92ac-409b-858c-21df2030d7b1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:35.175901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 543/1111] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:35.181110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:35.181544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:35.181639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:35.199396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:35.200607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:35.245751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:35.265573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 569/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:35.537986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94daa5-92ac-409b-858c-21df2030d7b1 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:35.635989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94daa5-92ac-409b-858c-21df2030d7b1 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:35.648285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:35.669562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:35.670185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:35.670463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:35.670734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] PATH_INFO: `/v3/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:35.672136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] RBAC: Authorizing `identity:get_role(role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:35.673494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:35.674808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 544/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:35 2022] GET /identity/v3/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:35.680598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:35.782600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6409-90bd-43b0-9abb-824d0080e09d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:35.814675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:35.815229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:35.815503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:35.815769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] PATH_INFO: `/v3/users/d1215b5842e24358baa110eacfa488e6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:35.828596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] RBAC: Authorizing `identity:get_user(user_id=d1215b5842e24358baa110eacfa488e6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:35.830007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:35.831566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 570/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:35 2022] GET /identity/v3/users/d1215b5842e24358baa110eacfa488e6 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:35.837990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:35.936331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5783-8fd9-4682-b5b0-3a63bb5fc6bf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:35.968145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:35.968740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:35.969019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:35.969293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:36.015847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:36.036914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:36.038352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:36.130911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 545/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:17:36.137528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:36.176673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:36.233696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3571095-2c2b-4b1a-bb07-8e7376b6715d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:36.266062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d0c8b-ecb0-4271-9cf0-9a0a9982015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:36.266674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d0c8b-ecb0-4271-9cf0-9a0a9982015e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:36.266949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d0c8b-ecb0-4271-9cf0-9a0a9982015e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:36.267214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d0c8b-ecb0-4271-9cf0-9a0a9982015e None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:36.268326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d0c8b-ecb0-4271-9cf0-9a0a9982015e None admin] RBAC: Authorizing `identity:get_project(project_id=1c428b776ce84c8098d480f28d0ab916)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:36.269729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d0c8b-ecb0-4271-9cf0-9a0a9982015e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:36.271321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 571/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:36 2022] GET /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:36.277458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:36.354474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:36.373566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eac13-3053-47bf-8695-c52cb2401e38 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:36.405567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:36.406110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:36.406391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:36.406664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:36.407382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] RBAC: Adding query filter params (role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=1c428b776ce84c8098d480f28d0ab916, user.id=d1215b5842e24358baa110eacfa488e6) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:36.407695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:36.409153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479679e8-24ab-4e2c-9e8b-fdb58976e4e1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:36.414317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 546/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:36 2022] GET /identity/v3/role_assignments?user.id=d1215b5842e24358baa110eacfa488e6&scope.project.id=1c428b776ce84c8098d480f28d0ab916&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:38.516651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2983bc-e3a8-4510-a514-9ae0de233da9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:38.517152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2983bc-e3a8-4510-a514-9ae0de233da9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:38.517152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2983bc-e3a8-4510-a514-9ae0de233da9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:38.518448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 572/1118] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:38.523849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:38.524298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:38.524408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:38.543281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:38.544493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:38.608211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 547/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:38.875897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2983bc-e3a8-4510-a514-9ae0de233da9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:38.971350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2983bc-e3a8-4510-a514-9ae0de233da9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:38.980592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:39.004240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:39.004852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:39.005126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:39.005393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] PATH_INFO: `/v3/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:39.006752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] RBAC: Authorizing `identity:get_role(role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:39.008122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:39.009434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 573/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:38 2022] GET /identity/v3/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:39.015112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:39.085138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:39.110069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8f44a-8feb-41fa-826c-27ece980f8aa None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:39.142208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:39.142769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:39.143048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:39.143323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] PATH_INFO: `/v3/users/d1215b5842e24358baa110eacfa488e6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:39.144457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] RBAC: Authorizing `identity:get_user(user_id=d1215b5842e24358baa110eacfa488e6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:39.145889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:39.147440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 548/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:39 2022] GET /identity/v3/users/d1215b5842e24358baa110eacfa488e6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:39.153520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:39.250639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de2e0-0249-4967-9ed3-4105ba93bab2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:39.283112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732321d5-a30e-4e81-be24-c9eb5ff77f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:39.283729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732321d5-a30e-4e81-be24-c9eb5ff77f7c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:39.284028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732321d5-a30e-4e81-be24-c9eb5ff77f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:39.284299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732321d5-a30e-4e81-be24-c9eb5ff77f7c None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:39.285397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732321d5-a30e-4e81-be24-c9eb5ff77f7c None admin] RBAC: Authorizing `identity:get_project(project_id=1c428b776ce84c8098d480f28d0ab916)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:39.286809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732321d5-a30e-4e81-be24-c9eb5ff77f7c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:39.288442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 574/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:39 2022] GET /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:39.294360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:39.388422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1caf8b-1f61-408c-af8f-f675eb5545fb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:39.420379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19701-0e55-40f5-8a11-3722a9848ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:39.420963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19701-0e55-40f5-8a11-3722a9848ad2 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:39.421239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19701-0e55-40f5-8a11-3722a9848ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:39.421508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19701-0e55-40f5-8a11-3722a9848ad2 None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916/users/d1215b5842e24358baa110eacfa488e6/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:39.423692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19701-0e55-40f5-8a11-3722a9848ad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c428b776ce84c8098d480f28d0ab916, user_id=d1215b5842e24358baa110eacfa488e6, role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:39.425142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f19701-0e55-40f5-8a11-3722a9848ad2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:39.437440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 549/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:17:39 2022] PUT /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916/users/d1215b5842e24358baa110eacfa488e6/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:17:41.545474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9f0a-cbff-4d5a-ad0b-79d899663337 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:41.545968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9f0a-cbff-4d5a-ad0b-79d899663337 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:41.545968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9f0a-cbff-4d5a-ad0b-79d899663337 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:41.547262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 575/1124] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:41.552554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:41.553008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:41.553103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:41.559325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:41.572942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:41.574115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:41.637434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 550/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:41.904151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9f0a-cbff-4d5a-ad0b-79d899663337 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:41.949178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:42.000965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f9f0a-cbff-4d5a-ad0b-79d899663337 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:42.033020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:42.033627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:42.033904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:42.034172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] PATH_INFO: `/v3/roles/3c4db4eeffac4984b6cc34c3b7e0f414` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:42.035530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] RBAC: Authorizing `identity:get_role(role_id=3c4db4eeffac4984b6cc34c3b7e0f414)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:42.036909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:42.038192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 576/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:41 2022] GET /identity/v3/roles/3c4db4eeffac4984b6cc34c3b7e0f414 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:42.043882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:42.139046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eac57c-09e8-46ba-9e72-725dabac6ecb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:42.166579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:42.171920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:42.172564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:42.172841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:42.173112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] PATH_INFO: `/v3/users/d1215b5842e24358baa110eacfa488e6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:42.174219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] RBAC: Authorizing `identity:get_user(user_id=d1215b5842e24358baa110eacfa488e6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:42.175635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:42.177214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 551/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:42 2022] GET /identity/v3/users/d1215b5842e24358baa110eacfa488e6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:42.183242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:42.281283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448e13-3075-473f-bdb0-2488f633796c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:42.294253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:42.315722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:42.316343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:42.316619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:42.316885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:42.380637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:42.382064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:42.473855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 577/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:17:42.480279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:42.574575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396f2e4-bc47-4a64-8740-587d970670b3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:42.607217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0329b-8e70-479a-b93f-fee113444755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:42.607826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0329b-8e70-479a-b93f-fee113444755 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:42.608135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0329b-8e70-479a-b93f-fee113444755 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:42.608406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0329b-8e70-479a-b93f-fee113444755 None admin] PATH_INFO: `/v3/projects/1c428b776ce84c8098d480f28d0ab916` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:42.609505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0329b-8e70-479a-b93f-fee113444755 None admin] RBAC: Authorizing `identity:get_project(project_id=1c428b776ce84c8098d480f28d0ab916)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:42.610925 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0329b-8e70-479a-b93f-fee113444755 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:42.612544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 552/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:42 2022] GET /identity/v3/projects/1c428b776ce84c8098d480f28d0ab916 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:42.618510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:42.632108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:42.712527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ddf38-7fc4-4869-a0fe-b758886eec1d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:42.744540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:42.745069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:42.745351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:42.745618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:42.746326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] RBAC: Adding query filter params (role.id=3c4db4eeffac4984b6cc34c3b7e0f414, scope.project.id=1c428b776ce84c8098d480f28d0ab916, user.id=d1215b5842e24358baa110eacfa488e6) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:42.746627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:42.748318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9953a-7838-4fdf-9adf-c6656476014d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:42.753766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 578/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:42 2022] GET /identity/v3/role_assignments?user.id=d1215b5842e24358baa110eacfa488e6&scope.project.id=1c428b776ce84c8098d480f28d0ab916&role.id=3c4db4eeffac4984b6cc34c3b7e0f414 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:44.932302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9065c5-b6ad-4f23-bc33-d1703aa6b1b5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:44.932828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9065c5-b6ad-4f23-bc33-d1703aa6b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:44.932828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9065c5-b6ad-4f23-bc33-d1703aa6b1b5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:44.934204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 553/1131] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:44.939637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:44.940059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:44.940211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:44.958607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:44.959782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:45.023726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 579/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:45.293428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9065c5-b6ad-4f23-bc33-d1703aa6b1b5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:45.358427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:45.391327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9065c5-b6ad-4f23-bc33-d1703aa6b1b5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:45.424187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c04d8-c115-49dc-81e5-317809becfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:45.424805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c04d8-c115-49dc-81e5-317809becfff None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:45.425080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c04d8-c115-49dc-81e5-317809becfff None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:45.425351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c04d8-c115-49dc-81e5-317809becfff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:45.426445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c04d8-c115-49dc-81e5-317809becfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:45.427856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c04d8-c115-49dc-81e5-317809becfff None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:45.429424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 554/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:45.436003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:45.443879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:45.532308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641474-aea2-4455-a4a0-7e78849b6658 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:45.564947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b89eb7-2418-4f23-b57e-cd65d810ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:45.565548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b89eb7-2418-4f23-b57e-cd65d810ce3b None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:45.565825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b89eb7-2418-4f23-b57e-cd65d810ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:45.566094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b89eb7-2418-4f23-b57e-cd65d810ce3b None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:45.566745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b89eb7-2418-4f23-b57e-cd65d810ce3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:45.568210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b89eb7-2418-4f23-b57e-cd65d810ce3b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:45.593335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 580/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:17:45 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:17:47.743792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19144-cd44-4697-9f73-32e11bb9e1a8 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:47.744384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19144-cd44-4697-9f73-32e11bb9e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:47.744384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19144-cd44-4697-9f73-32e11bb9e1a8 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:47.745704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 555/1135] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:47.751691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:47.752119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:47.752253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:47.769846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:47.771016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:47.821651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:47.835667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 581/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:48.104544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19144-cd44-4697-9f73-32e11bb9e1a8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:48.202442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19144-cd44-4697-9f73-32e11bb9e1a8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:48.234984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c642b4-8c67-4cbf-b619-d28eb59a9157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:48.235595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642b4-8c67-4cbf-b619-d28eb59a9157 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:48.235869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642b4-8c67-4cbf-b619-d28eb59a9157 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:48.236164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642b4-8c67-4cbf-b619-d28eb59a9157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:48.237253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642b4-8c67-4cbf-b619-d28eb59a9157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:48.238658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642b4-8c67-4cbf-b619-d28eb59a9157 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:48.240229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 556/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:17:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:48.246290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:48.340719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893526d-2c8c-41b1-8dba-49bccb5bf3e7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:48.373561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627171-0e1a-45ec-aa84-9f4692439628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:48.374181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627171-0e1a-45ec-aa84-9f4692439628 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:48.374460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627171-0e1a-45ec-aa84-9f4692439628 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:48.374730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627171-0e1a-45ec-aa84-9f4692439628 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:48.375386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627171-0e1a-45ec-aa84-9f4692439628 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:48.376830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627171-0e1a-45ec-aa84-9f4692439628 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:48.397320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 582/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:17:48 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:17:50.614551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb11ba4-9a8b-4c3d-9ab0-19340fe1f114 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:50.615056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb11ba4-9a8b-4c3d-9ab0-19340fe1f114 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:50.615056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb11ba4-9a8b-4c3d-9ab0-19340fe1f114 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:50.616357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 557/1139] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:50.622098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:50.622720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:50.622889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:50.640589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:50.641758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:50.679088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:50.706725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 583/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:50.976706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb11ba4-9a8b-4c3d-9ab0-19340fe1f114 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:50.981179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:51.074607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb11ba4-9a8b-4c3d-9ab0-19340fe1f114 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:51.107363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:51.108002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:51.108285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:51.108563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:51.118275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:51.123298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:51.124574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:51.125761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 558/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:51.130169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:51.233541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09e18b-cc60-4cfc-9a9c-62cdfd917a20 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:51.266170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:51.266772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:51.267050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:51.267319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:51.267999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:51.268301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:51.269649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:51.278012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 584/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:51.283992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:51.344138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:51.380550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe458-6dd1-41aa-86f4-f59e160e5def None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:51.413594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:51.414217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:51.414499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:51.414774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] PATH_INFO: `/v3/users/8859933050ce4ab6949e8c659a610b29` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:51.427252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] RBAC: Authorizing `identity:get_user(user_id=8859933050ce4ab6949e8c659a610b29)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:51.428718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:51.430304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 559/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:51 2022] GET /identity/v3/users/8859933050ce4ab6949e8c659a610b29 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:51.436068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:51.470548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:51.534903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35210ca-f88a-44b8-bcf0-cac65fd99e35 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:51.566905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:51.567506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:51.567780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:51.568078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:51.633009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:51.635049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:51.665978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:51.731090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 585/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:17:51.737021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:51.832140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2af11b-5a43-4c90-a8b6-ada644489deb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:51.853252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:51.864959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36836a10-eed0-413d-8e8e-bd01b1a0c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:51.865584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836a10-eed0-413d-8e8e-bd01b1a0c187 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:51.865862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836a10-eed0-413d-8e8e-bd01b1a0c187 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:51.866134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836a10-eed0-413d-8e8e-bd01b1a0c187 None admin] PATH_INFO: `/v3/projects/5d61bdfbb9ac463fb66d29661a501254` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:51.867233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36836a10-eed0-413d-8e8e-bd01b1a0c187 None admin] RBAC: Authorizing `identity:get_project(project_id=5d61bdfbb9ac463fb66d29661a501254)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:51.869176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36836a10-eed0-413d-8e8e-bd01b1a0c187 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:51.870785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 560/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:51 2022] GET /identity/v3/projects/5d61bdfbb9ac463fb66d29661a501254 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:51.877023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:51.971235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e323e9-f33e-435b-a8e2-a0b2e7cbb9db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:52.004486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:52.005081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:52.005359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:52.005632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:52.006348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=5d61bdfbb9ac463fb66d29661a501254, user.id=8859933050ce4ab6949e8c659a610b29) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:52.006655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:52.008110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ddc37-af67-42be-94c3-d5a7dc86ea18 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:52.010842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:52.014618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 586/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:51 2022] GET /identity/v3/role_assignments?user.id=8859933050ce4ab6949e8c659a610b29&scope.project.id=5d61bdfbb9ac463fb66d29661a501254&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:54.099231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f59510-a186-4ea1-a636-e5525daed251 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:54.099764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f59510-a186-4ea1-a636-e5525daed251 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:54.099764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f59510-a186-4ea1-a636-e5525daed251 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:54.101258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 561/1147] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:54.106927 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:54.107347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:54.107468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:54.126284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:54.127460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:54.191375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 587/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:54.455483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f59510-a186-4ea1-a636-e5525daed251 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:54.552617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f59510-a186-4ea1-a636-e5525daed251 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:54.584761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:54.585376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:54.585658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:54.585932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:54.596227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:54.601011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:54.602081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:17:54.603173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 562/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:54.608862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:54.703459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f6185-5ceb-44d4-aa66-d580bce7ba42 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:54.730311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:54.736454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:54.737050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:54.737329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:54.737601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:54.738258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:54.738559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:54.739969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:54.748574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 588/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:54.754225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:54.804015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:54.851773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281da5f-c239-497c-9a2f-32418e7c36da None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:54.885567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:54.886181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:54.886460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:54.886731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] PATH_INFO: `/v3/users/8859933050ce4ab6949e8c659a610b29` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:54.887836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] RBAC: Authorizing `identity:get_user(user_id=8859933050ce4ab6949e8c659a610b29)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:54.889310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:54.890868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 563/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:54 2022] GET /identity/v3/users/8859933050ce4ab6949e8c659a610b29 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:54.896618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:54.991428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681cb7-3056-4df1-a2d4-bdb6ad499b78 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:55.023224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057304e1-e2c2-40ef-be6d-4d59d19c6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:55.023844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057304e1-e2c2-40ef-be6d-4d59d19c6953 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:55.024143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057304e1-e2c2-40ef-be6d-4d59d19c6953 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:55.024410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057304e1-e2c2-40ef-be6d-4d59d19c6953 None admin] PATH_INFO: `/v3/projects/5d61bdfbb9ac463fb66d29661a501254` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:55.025496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057304e1-e2c2-40ef-be6d-4d59d19c6953 None admin] RBAC: Authorizing `identity:get_project(project_id=5d61bdfbb9ac463fb66d29661a501254)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:55.026901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057304e1-e2c2-40ef-be6d-4d59d19c6953 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:55.028529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 589/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:54 2022] GET /identity/v3/projects/5d61bdfbb9ac463fb66d29661a501254 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:55.034353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:55.130007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502e85-d847-4a81-ae41-a7aebdf502ee None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:55.146087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:55.161901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b3658-9658-498d-bad1-6204d34c62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:55.162537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3658-9658-498d-bad1-6204d34c62ca None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:55.162810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3658-9658-498d-bad1-6204d34c62ca None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:55.163079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b3658-9658-498d-bad1-6204d34c62ca None admin] PATH_INFO: `/v3/projects/5d61bdfbb9ac463fb66d29661a501254/users/8859933050ce4ab6949e8c659a610b29/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:55.165547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3658-9658-498d-bad1-6204d34c62ca None admin] RBAC: Authorizing `identity:create_grant(project_id=5d61bdfbb9ac463fb66d29661a501254, user_id=8859933050ce4ab6949e8c659a610b29, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:55.166948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b3658-9658-498d-bad1-6204d34c62ca None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:55.179276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 564/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:17:55 2022] PUT /identity/v3/projects/5d61bdfbb9ac463fb66d29661a501254/users/8859933050ce4ab6949e8c659a610b29/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:17:57.289893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a7c98-0382-492f-9f86-70e23a11fa69 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:57.290906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a7c98-0382-492f-9f86-70e23a11fa69 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:57.291000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a7c98-0382-492f-9f86-70e23a11fa69 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:57.292317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 590/1154] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:17:57.297500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:57.297915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:57.298097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:57.316131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:17:57.317293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:17:57.380646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 565/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:17:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:17:57.647259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a7c98-0382-492f-9f86-70e23a11fa69 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:57.706035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:57.747018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a7c98-0382-492f-9f86-70e23a11fa69 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:57.778985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:57.779602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:57.779876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:57.780174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:57.790752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:17:57.795510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:17:57.796614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:17:57.797637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 591/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:17:57.802789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:57.901027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef059de-651f-4315-a3a0-afd4f9fad432 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:57.909788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:57.934998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:57.935597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:57.935874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:57.936184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:57.936838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:57.937137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:57.938518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:57.946219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 566/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:57.952666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:58.046715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698f8f-f218-473b-8b6e-319781263780 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:58.065033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:58.078825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:58.079433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:58.079710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:58.080012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] PATH_INFO: `/v3/users/8859933050ce4ab6949e8c659a610b29` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:58.081103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] RBAC: Authorizing `identity:get_user(user_id=8859933050ce4ab6949e8c659a610b29)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:58.082509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:58.084065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 592/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:17:57 2022] GET /identity/v3/users/8859933050ce4ab6949e8c659a610b29 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:58.090248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:58.186789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec682d-3ca4-4d0f-a5c4-ba5733c98965 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:58.219712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:58.220338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:58.220616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:58.220884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:58.256780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:58.284545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:58.285968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:58.378714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 567/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:17:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:17:58.385417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:58.479975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26c67c-2bdd-487d-b946-f22291609de4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:58.512021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6561cc-9b0d-4a33-96fc-a5db46399b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:58.512624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6561cc-9b0d-4a33-96fc-a5db46399b74 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:58.512897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6561cc-9b0d-4a33-96fc-a5db46399b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:58.513160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6561cc-9b0d-4a33-96fc-a5db46399b74 None admin] PATH_INFO: `/v3/projects/5d61bdfbb9ac463fb66d29661a501254` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:58.514244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6561cc-9b0d-4a33-96fc-a5db46399b74 None admin] RBAC: Authorizing `identity:get_project(project_id=5d61bdfbb9ac463fb66d29661a501254)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:58.515634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6561cc-9b0d-4a33-96fc-a5db46399b74 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:58.517237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 593/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:17:58 2022] GET /identity/v3/projects/5d61bdfbb9ac463fb66d29661a501254 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:17:58.523047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:17:58.587449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:17:58.616388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d812f-e47e-4a1e-a158-91adb73c3843 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:17:58.651486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:17:58.652403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:17:58.652825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:17:58.653239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:17:58.654105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=5d61bdfbb9ac463fb66d29661a501254, user.id=8859933050ce4ab6949e8c659a610b29) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:17:58.654411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:17:58.655916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca99c81-9639-42fd-819e-bc38137985ec None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:17:58.662321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 568/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:17:58 2022] GET /identity/v3/role_assignments?user.id=8859933050ce4ab6949e8c659a610b29&scope.project.id=5d61bdfbb9ac463fb66d29661a501254&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:00.849171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a066c5-48ab-4ce6-8705-12bc526caa69 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:00.849755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a066c5-48ab-4ce6-8705-12bc526caa69 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:00.849755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a066c5-48ab-4ce6-8705-12bc526caa69 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:00.851054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 594/1162] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:00.856224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:00.856650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:00.856747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:00.874980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:00.876159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:00.941021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 569/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:01.211750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a066c5-48ab-4ce6-8705-12bc526caa69 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:01.273475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:01.317708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a066c5-48ab-4ce6-8705-12bc526caa69 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:01.349687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:01.350295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:01.350574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:01.350847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:01.414838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:01.416919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:01.470951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:01.514289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 595/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:18:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:18:01.520326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:01.578589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:01.620508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bb783-3b02-455e-be33-d0fa30a15d4a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:01.653450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:01.654067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:01.654342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:01.654607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:01.660924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:01.662342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-48b900e1-3f50-4eec-92cc-aadd76fa6421 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:18:01.673877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:18:01.675135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:18:01.676294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 570/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:18:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:18:01.681087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:01.780836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66f0b0-261a-40c6-8341-469eaf3fd43a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:01.812917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:01.813517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:01.813794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:01.814065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:01.814703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:18:01.815006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:01.816387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae4a4-a5db-4e6f-8bc1-a778453c8eb0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:01.823754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 596/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 22 12:18:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:03.970637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b712a49-d360-494e-b422-cd599c335ab3 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:03.971191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b712a49-d360-494e-b422-cd599c335ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:03.971191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b712a49-d360-494e-b422-cd599c335ab3 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:03.972563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 571/1167] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:03.977718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486cfd7-3577-437a-b7b5-5f850e995240 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:03.978130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486cfd7-3577-437a-b7b5-5f850e995240 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:03.978322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486cfd7-3577-437a-b7b5-5f850e995240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:03.996045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1486cfd7-3577-437a-b7b5-5f850e995240 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:03.997228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1486cfd7-3577-437a-b7b5-5f850e995240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:04.011536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:04.062440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 597/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:04.332955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b712a49-d360-494e-b422-cd599c335ab3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:04.433156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b712a49-d360-494e-b422-cd599c335ab3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:04.455157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:04.465857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56060e-de7d-46b1-83c6-935c593aebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:04.466453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56060e-de7d-46b1-83c6-935c593aebe2 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:04.466732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56060e-de7d-46b1-83c6-935c593aebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:04.467004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56060e-de7d-46b1-83c6-935c593aebe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:04.467673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56060e-de7d-46b1-83c6-935c593aebe2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:04.469067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56060e-de7d-46b1-83c6-935c593aebe2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:04.483884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 572/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Thu Sep 22 12:18:04 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:18:06.660676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68156d2-ca17-4c95-b6f2-583b9d933a36 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:06.661392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68156d2-ca17-4c95-b6f2-583b9d933a36 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:06.661392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68156d2-ca17-4c95-b6f2-583b9d933a36 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:06.662543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 598/1170] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:06.668840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:06.669303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:06.669404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:06.687099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:06.688308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:06.751941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 573/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:07.023726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68156d2-ca17-4c95-b6f2-583b9d933a36 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:07.120082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68156d2-ca17-4c95-b6f2-583b9d933a36 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:07.153510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f854b9-43de-413d-a1be-bb97f612b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:07.154123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f854b9-43de-413d-a1be-bb97f612b7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:07.154401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f854b9-43de-413d-a1be-bb97f612b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:07.154673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f854b9-43de-413d-a1be-bb97f612b7e0 None admin] PATH_INFO: `/v3/domains/eda2b990846b46099823af84528ad9cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:07.164657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f854b9-43de-413d-a1be-bb97f612b7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=eda2b990846b46099823af84528ad9cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:07.166087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f854b9-43de-413d-a1be-bb97f612b7e0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:07.167637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 599/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Sep 22 12:18:07 2022] GET /identity/v3/domains/eda2b990846b46099823af84528ad9cb => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:07.173203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:07.268650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9d8e9-8913-4d81-87d9-9691657e6317 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:07.282630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:07.302538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072bea6-3057-441b-a68b-a96604798e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:07.303136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072bea6-3057-441b-a68b-a96604798e6d None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:07.303415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072bea6-3057-441b-a68b-a96604798e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:07.303685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072bea6-3057-441b-a68b-a96604798e6d None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:07.304438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072bea6-3057-441b-a68b-a96604798e6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:07.305867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072bea6-3057-441b-a68b-a96604798e6d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:07.331939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 574/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:18:07 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:18:09.472896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e7e-4b9b-40b9-b2ad-5629f6f05910 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:09.473410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e7e-4b9b-40b9-b2ad-5629f6f05910 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:09.473410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36140e7e-4b9b-40b9-b2ad-5629f6f05910 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:09.474717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 600/1174] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:09.480461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:09.480891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:09.480990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:09.499574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:09.500777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:09.565011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 575/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:09.835983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140e7e-4b9b-40b9-b2ad-5629f6f05910 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:09.849776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:09.937715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36140e7e-4b9b-40b9-b2ad-5629f6f05910 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:09.970078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519c51-be78-4233-a1f9-7c8e272aa6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:09.970695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519c51-be78-4233-a1f9-7c8e272aa6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:09.970971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519c51-be78-4233-a1f9-7c8e272aa6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:09.971240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519c51-be78-4233-a1f9-7c8e272aa6f6 None admin] PATH_INFO: `/v3/domains/eda2b990846b46099823af84528ad9cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:09.972361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b519c51-be78-4233-a1f9-7c8e272aa6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=eda2b990846b46099823af84528ad9cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:09.973782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b519c51-be78-4233-a1f9-7c8e272aa6f6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:09.975335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 601/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Sep 22 12:18:09 2022] GET /identity/v3/domains/eda2b990846b46099823af84528ad9cb => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:09.981037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:10.068494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:10.075329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8dd56-93cf-4418-a2b6-c85c1296f448 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:10.108154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a406de-60fa-4911-93db-776b62d559e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:10.108687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a406de-60fa-4911-93db-776b62d559e4 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:10.108966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a406de-60fa-4911-93db-776b62d559e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:10.109238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a406de-60fa-4911-93db-776b62d559e4 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:10.109884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a406de-60fa-4911-93db-776b62d559e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:10.111308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a406de-60fa-4911-93db-776b62d559e4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:10.131842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 576/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:18:09 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:18:12.300068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298dc0-f83f-4574-b8f5-518c16922d56 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:12.300584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298dc0-f83f-4574-b8f5-518c16922d56 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:12.300584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298dc0-f83f-4574-b8f5-518c16922d56 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:12.301933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 602/1178] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:12.307781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:12.308244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:12.308365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:12.326123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:12.327297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:12.391462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 577/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:12.656150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298dc0-f83f-4574-b8f5-518c16922d56 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:12.732540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:12.754565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298dc0-f83f-4574-b8f5-518c16922d56 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:12.786479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:12.787094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:12.787372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:12.787641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:12.798398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:18:12.803172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:18:12.804285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:18:12.805328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 603/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:18:12.810355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:12.888348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:12.907842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde32ff-c02a-415f-9755-fdc0624f94a8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:12.940929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:12.941521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:12.941797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:12.942068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:12.942723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:18:12.943024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:12.944418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:12.952593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 578/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:12.958535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:13.054584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10e9-4e08-4497-a5e3-ecb58e0d81a6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:13.090490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:13.091118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:13.091393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:13.091663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] PATH_INFO: `/v3/users/03351a8706b24e1fa8da21b7d4cc35c8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:13.099402 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:13.106286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] RBAC: Authorizing `identity:get_user(user_id=03351a8706b24e1fa8da21b7d4cc35c8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:13.107715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:13.109357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 604/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:18:12 2022] GET /identity/v3/users/03351a8706b24e1fa8da21b7d4cc35c8 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:13.115234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:13.211655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18914da7-aaf4-4c2b-9174-672770f41816 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:13.243359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:13.243998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:13.244279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:13.244545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:13.258157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:13.309521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:13.310955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:13.405255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 579/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:18:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:18:13.411210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:13.506332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea555bd-9869-4c56-bcc9-944745325e8c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:13.538837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f9a8-7fff-4dd3-9dda-1f3380aaa061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:13.539456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f9a8-7fff-4dd3-9dda-1f3380aaa061 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:13.539736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f9a8-7fff-4dd3-9dda-1f3380aaa061 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:13.540037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f9a8-7fff-4dd3-9dda-1f3380aaa061 None admin] PATH_INFO: `/v3/projects/c7c1291b61ae46439293b229e48c1bb7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:13.541159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f9a8-7fff-4dd3-9dda-1f3380aaa061 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c1291b61ae46439293b229e48c1bb7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:13.542581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f9a8-7fff-4dd3-9dda-1f3380aaa061 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:13.544271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 605/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:18:13 2022] GET /identity/v3/projects/c7c1291b61ae46439293b229e48c1bb7 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:13.550168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:13.593775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:13.645452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72756-816c-42e1-a2d5-9a97b84724e2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:13.677047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:13.677633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:13.677908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:13.678177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:13.678885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=c7c1291b61ae46439293b229e48c1bb7, user.id=03351a8706b24e1fa8da21b7d4cc35c8) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:18:13.679189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:13.680632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97c751-5aeb-4b8f-846e-b80329f2d523 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:13.686249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 580/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:18:13 2022] GET /identity/v3/role_assignments?user.id=03351a8706b24e1fa8da21b7d4cc35c8&scope.project.id=c7c1291b61ae46439293b229e48c1bb7&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:15.812355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4df5-dca0-4b03-ad50-2a29a595d2a1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:15.812909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4df5-dca0-4b03-ad50-2a29a595d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:15.812909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4df5-dca0-4b03-ad50-2a29a595d2a1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:15.814225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 606/1186] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:15.819382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:15.819778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:15.819916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:15.838151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:15.839308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:15.902693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 581/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:16.170775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f4df5-dca0-4b03-ad50-2a29a595d2a1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:16.232461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:16.269801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f4df5-dca0-4b03-ad50-2a29a595d2a1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:16.302596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:16.303218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:16.303498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:16.303769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:16.314287 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:18:16.319094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:18:16.320217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:18:16.321216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 607/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:18:16.326355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:16.367523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:16.425632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7b04-5988-4cca-9b7d-8006a99ec65a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:16.456875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:16.457468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:16.457747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:16.458017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:16.458667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:18:16.458965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:16.460352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:16.468484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 582/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:16.475819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:16.570336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae46e3-9a89-4f19-8d2c-91290d482fff None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:16.593147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:16.604465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:16.605078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:16.605355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:16.605625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] PATH_INFO: `/v3/users/03351a8706b24e1fa8da21b7d4cc35c8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:16.606732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] RBAC: Authorizing `identity:get_user(user_id=03351a8706b24e1fa8da21b7d4cc35c8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:16.608175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:16.609723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 608/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:18:16 2022] GET /identity/v3/users/03351a8706b24e1fa8da21b7d4cc35c8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:16.615477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:16.710712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:16.714394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6a891-f034-4fed-af3c-e390c4923a96 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:16.746687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cde2ab-daa5-4300-a285-080c00a70724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:16.747315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde2ab-daa5-4300-a285-080c00a70724 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:16.747596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde2ab-daa5-4300-a285-080c00a70724 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:16.747871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cde2ab-daa5-4300-a285-080c00a70724 None admin] PATH_INFO: `/v3/projects/c7c1291b61ae46439293b229e48c1bb7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:16.749010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde2ab-daa5-4300-a285-080c00a70724 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c1291b61ae46439293b229e48c1bb7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:16.750702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cde2ab-daa5-4300-a285-080c00a70724 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:16.752380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 583/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:18:16 2022] GET /identity/v3/projects/c7c1291b61ae46439293b229e48c1bb7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:16.758537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:16.855451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c28c3-399f-47a5-bea1-a54351bed315 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:16.888417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ddd68-2d15-451c-95f9-550d074c6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:16.889062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ddd68-2d15-451c-95f9-550d074c6eac None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:16.889340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ddd68-2d15-451c-95f9-550d074c6eac None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:16.889613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ddd68-2d15-451c-95f9-550d074c6eac None admin] PATH_INFO: `/v3/projects/c7c1291b61ae46439293b229e48c1bb7/users/03351a8706b24e1fa8da21b7d4cc35c8/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:16.891517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ddd68-2d15-451c-95f9-550d074c6eac None admin] RBAC: Authorizing `identity:create_grant(project_id=c7c1291b61ae46439293b229e48c1bb7, user_id=03351a8706b24e1fa8da21b7d4cc35c8, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:16.892959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ddd68-2d15-451c-95f9-550d074c6eac None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:16.905703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 609/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:18:16 2022] PUT /identity/v3/projects/c7c1291b61ae46439293b229e48c1bb7/users/03351a8706b24e1fa8da21b7d4cc35c8/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:18:19.025847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f192f4-2d2a-43ea-beca-6db3cb544a78 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:19.026379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f192f4-2d2a-43ea-beca-6db3cb544a78 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:19.026379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f192f4-2d2a-43ea-beca-6db3cb544a78 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:19.027715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 584/1193] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:18:19.033078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:19.033497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:19.033623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:19.051752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:18:19.052973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:18:19.097834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:19.118329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 610/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:18:19.386081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f192f4-2d2a-43ea-beca-6db3cb544a78 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:19.483326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f192f4-2d2a-43ea-beca-6db3cb544a78 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:19.514612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:19.515218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:19.515491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:19.515757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:19.526186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:18:19.530970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:18:19.532090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:18:19.533194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 585/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:18:19.537797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:19.631993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e78811-9ba1-4891-bb8e-e1e7005f0dd8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:19.664404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:19.664939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:19.665214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:19.665480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:19.666714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:18:19.667010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:19.668416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:19.676054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 611/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:19.681623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:19.716034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:19.799047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31adccb-c8c1-487a-a9f3-e50ff0e6a50e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:19.833090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:19.833709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:19.833990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:19.834254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] PATH_INFO: `/v3/users/03351a8706b24e1fa8da21b7d4cc35c8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:19.835353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] RBAC: Authorizing `identity:get_user(user_id=03351a8706b24e1fa8da21b7d4cc35c8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:19.836796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:19.838984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 586/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 22 12:18:19 2022] GET /identity/v3/users/03351a8706b24e1fa8da21b7d4cc35c8 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:19.844839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:19.889358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:19.940628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8a24-ed52-43c4-8520-16482d725b02 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:19.972950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:19.973551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:19.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:19.974104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:20.039329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:20.040928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:20.090306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:20.148827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 612/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:18:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:18:20.154935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:20.245577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:20.251689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e72b2-773d-4e32-993a-9328e96d0137 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:20.283513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584f8e3-e168-473f-badb-1331d503d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:20.284152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f8e3-e168-473f-badb-1331d503d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:20.284435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f8e3-e168-473f-badb-1331d503d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:20.284704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584f8e3-e168-473f-badb-1331d503d9f9 None admin] PATH_INFO: `/v3/projects/c7c1291b61ae46439293b229e48c1bb7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:20.285789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f8e3-e168-473f-badb-1331d503d9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c7c1291b61ae46439293b229e48c1bb7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:20.287205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584f8e3-e168-473f-badb-1331d503d9f9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:20.288845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 587/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 22 12:18:20 2022] GET /identity/v3/projects/c7c1291b61ae46439293b229e48c1bb7 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:20.294973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:18:20.390643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e884d30-c91e-4ce1-a0a7-1986deb11666 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:18:20.430250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:18:20.430849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:18:20.431123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:18:20.431880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:18:20.432630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=c7c1291b61ae46439293b229e48c1bb7, user.id=03351a8706b24e1fa8da21b7d4cc35c8) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:18:20.432933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:18:20.434339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54ef2f-4202-4ed9-86f8-6eed1bd4e6d2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:18:20.439925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 613/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:18:20 2022] GET /identity/v3/role_assignments?user.id=03351a8706b24e1fa8da21b7d4cc35c8&scope.project.id=c7c1291b61ae46439293b229e48c1bb7&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:18:30.279556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=18 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:18:30.437358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:15.832358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5c556-efc0-4030-b4ca-c03b4c9b1fc6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:15.832972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5c556-efc0-4030-b4ca-c03b4c9b1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:15.832972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5c556-efc0-4030-b4ca-c03b4c9b1fc6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:15.834641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 588/1201] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:15.840166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:15.840654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:15.840750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:15.861042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:15.862249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:15.941734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 614/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:16.209312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5c556-efc0-4030-b4ca-c03b4c9b1fc6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:16.344324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5c556-efc0-4030-b4ca-c03b4c9b1fc6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:16.382066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:16.382801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:16.383087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:16.383473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:16.398282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:16.399801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:16.416443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:16.417557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:16.418520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:16.418520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:16.418520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:16.418520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 589/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:16.424405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:16.566611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d999796-dd4b-4608-8b62-49f6054b848e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:16.601689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:16.609830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:16.610565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:16.610917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:16.611200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:16.611995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:16.612304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:16.613905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f0e5-1b93-43d9-a2f5-953b2c671f0e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:16.631976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 615/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:16.634177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:16.705498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:16.765908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155de1bb-8628-4d86-b477-2daebc4a083e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:16.806266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92454910-86f4-464d-ba4b-3c9f7332b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:16.806891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92454910-86f4-464d-ba4b-3c9f7332b0ec None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:16.807165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92454910-86f4-464d-ba4b-3c9f7332b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:16.807437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92454910-86f4-464d-ba4b-3c9f7332b0ec None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:16.808139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92454910-86f4-464d-ba4b-3c9f7332b0ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:16.809605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92454910-86f4-464d-ba4b-3c9f7332b0ec None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:16.834963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 590/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 22 12:19:16 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:19:19.212494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa780b-3927-4495-b4e2-e70e22078567 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:19.212494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa780b-3927-4495-b4e2-e70e22078567 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:19.212494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa780b-3927-4495-b4e2-e70e22078567 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:19.213599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 616/1206] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:19.218711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:19.219173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:19.219277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:19.240876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:19.242299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:19.319618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 591/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:19.619417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa780b-3927-4495-b4e2-e70e22078567 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:19.739659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa780b-3927-4495-b4e2-e70e22078567 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:19.782846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:19.783517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:19.783799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:19.784104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:19.796070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:19:19.801772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:19.802735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:19.803705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 617/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:19:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:19.809680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:19.853332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:19.921705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06b29-6c35-4e35-9425-4eb6fe57e02a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:19.960341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:19.960954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:19.961235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:19.961499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:19.962218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:19.962519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:19.963980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:19.973325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 592/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:19.980789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:20.036358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:20.095434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d63b-9422-48cc-9d12-714bf5d72a75 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:20.135803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:20.136523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:20.136757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:20.137006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:20.148074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:20.149507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:20.164891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:20.166135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:20.167237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:20.167237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:20.167237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:20.171109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 618/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:20.172500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:20.283573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:20.286771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbd873-0917-4324-b4e8-1de646fec422 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:20.325892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:20.326515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:20.326797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:20.327103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:20.327783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:20.328154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:20.329634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:20.342486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 593/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:20.348279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:20.459363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8d6c-c2c1-4230-a06a-58c07e324f6b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:20.461200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:20.500575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:20.501214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:20.501489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:20.501758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:20.510475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:20.512098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:19:20.524708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:20.531547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:20.532524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 619/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:20.533140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:20.646767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f5b23-c11f-4079-9700-671f5c4274af None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:20.687145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:20.687809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:20.688120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:20.688391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:20.689107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:20.689416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:20.690888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:20.714566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 594/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 22 12:19:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:19:20.716127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:20.857459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c642b-0b02-48d8-93a8-d5473d4d68e2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:20.902262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:20.902927 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:20.903129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:20.903372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:20.935890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:20.974957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:20.976462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:21.083416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 620/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:19:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:19:21.086633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:21.105967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:21.194968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e38f-1b49-40d6-b7ad-3abc92e07856 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:21.235469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:21.236088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:21.236370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:21.236644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:21.253360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:21.255100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:21.272451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:21.273487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:21.274978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:21.274978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:21.274978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:21.274978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 595/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:19:21.280104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:21.345869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:21.387583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aaca-03e5-44b8-a3a9-283fb8827de4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:21.428357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:21.429113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:21.429394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:21.429758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:21.430486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:21.430874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:21.432263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:21.444436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 621/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:21.451551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:21.532825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:21.570912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ddd96-523c-4913-89f0-c2022dbee93f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:21.606815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:21.607472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:21.607736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:21.608083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:21.615109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:21.616637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:19:21.628975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:21.630669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:21.631556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 596/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:19:21.636634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:21.746281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444d56d-3167-4bb8-be00-b50776d318bd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:21.771302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:21.785668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:21.785668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:21.785976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:21.786056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:21.786717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:21.787045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:21.788489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5a3d-f333-4baf-ad0c-3e48175d1252 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:21.804406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 622/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:21.811174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:21.942841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04cc5a-34ed-40a2-b7e8-5bf5ca832851 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:21.975845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:21.982770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:21.983384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:21.983654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:21.983945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:21.984693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=18dcb13de7d84c88bf32e41e103f7e8c) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:21.984988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:21.986400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413992b-a21e-415a-966b-3c3a9de2efa7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:21.997118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 597/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:19:21 2022] GET /identity/v3/role_assignments?user.id=18dcb13de7d84c88bf32e41e103f7e8c&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:24.335999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c1a1e-4f11-475d-a29f-0c3fb5b90212 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:24.336549 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c1a1e-4f11-475d-a29f-0c3fb5b90212 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:24.336714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c1a1e-4f11-475d-a29f-0c3fb5b90212 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:24.338113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 623/1220] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:24.345420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:24.345870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:24.345961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:24.364637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:24.365827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:24.437574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 598/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:24.732960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c1a1e-4f11-475d-a29f-0c3fb5b90212 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:24.849235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c1a1e-4f11-475d-a29f-0c3fb5b90212 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:24.892779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:24.893530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:24.893940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:24.894178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:24.906301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:19:24.911353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:24.912600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:24.913579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 624/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:19:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:24.919449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:25.029801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc6e2-edcc-4e33-a2c1-9b5245df1348 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:25.055556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:25.068292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:25.068992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:25.069337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:25.069603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:25.070323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:25.070642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:25.072150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:25.080897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 599/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:19:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:25.086928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:25.134486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:25.202946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13088a2b-f721-41a5-9b82-c343275f0e2b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:25.243107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:25.243775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:25.244121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:25.244439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:25.256145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:25.257608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:25.274602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:25.275711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:25.276651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:25.276651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:25.276651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:25.276651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 625/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:19:25.281927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:25.395775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495657e-3fab-4208-b095-8d519a7cb69c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:25.432282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:25.433000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:25.433339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:25.433595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:25.434295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:25.434628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:25.436082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:25.448031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 600/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:25.455920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:25.560420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:25.567608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa76640-7d64-4244-9228-998bbfbad677 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:25.603914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:25.604595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:25.604855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:25.605130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:25.613326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:25.614836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:19:25.626158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:25.627296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:25.628658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 626/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:25.633591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:25.684087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:25.738278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef158-dabb-4a2a-9e0d-c70623c50a6c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:25.773387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:25.774030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:25.774281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:25.774535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:25.775247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:25.775549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:25.777120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:25.795697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 601/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 22 12:19:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:19:25.802060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:25.917602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069c50-5777-4d57-89e8-65ed8071526b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:25.954152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:25.954780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:25.955058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:25.955327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:25.966772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:25.968241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:25.983827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:25.985300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:25.986296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:25.986296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:25.986296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:25.986296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 627/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:25.991087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:26.108515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76bfd7-0b21-466a-9c96-81750a9f340d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:26.110827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:26.146765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:26.147417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:26.147724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:26.148048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:26.148694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:26.149002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:26.150373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:26.163781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 602/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:26.170175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:26.179849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:26.278508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b90d30-c960-4e49-bf13-bd3e300b2265 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:26.312834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:26.313516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:26.313882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:26.314264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:26.321655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:26.323157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:19:26.337141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:26.338043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:26.339299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 628/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:26.345189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:26.456436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1c905-994b-4d13-9b98-9a832fc51b34 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:26.492135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:26.492740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:26.493065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:26.493412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:26.494112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:26.494426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:26.496092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedbb65-6cbd-4d9e-9864-9dc0475f2f6f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:26.509506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 603/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:26.515779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:26.587182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:26.625645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8607d-9e9e-4b3c-859f-3fc753fe3aee None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:26.664302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525322bc-b940-4c42-8cc7-46bcc79f1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:26.664971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525322bc-b940-4c42-8cc7-46bcc79f1fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:26.665248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525322bc-b940-4c42-8cc7-46bcc79f1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:26.665525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525322bc-b940-4c42-8cc7-46bcc79f1fe1 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/18dcb13de7d84c88bf32e41e103f7e8c/roles/3232592d86b145d1889de54a518e3fed` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:26.682449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525322bc-b940-4c42-8cc7-46bcc79f1fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=18dcb13de7d84c88bf32e41e103f7e8c, role_id=3232592d86b145d1889de54a518e3fed)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:26.684286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525322bc-b940-4c42-8cc7-46bcc79f1fe1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:26.697944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 629/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:19:26 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/18dcb13de7d84c88bf32e41e103f7e8c/roles/3232592d86b145d1889de54a518e3fed => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:19:28.860234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c094-ddcc-4519-9657-916995f66787 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:28.860813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c094-ddcc-4519-9657-916995f66787 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:28.860813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c094-ddcc-4519-9657-916995f66787 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:28.862469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 604/1233] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:28.868623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:28.869160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:28.869160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:28.889677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:28.890907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:28.967715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 630/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:29.259598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c094-ddcc-4519-9657-916995f66787 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:29.289530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:29.379211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c094-ddcc-4519-9657-916995f66787 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:29.420518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:29.421406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:29.421737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:29.422097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:29.434127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:19:29.440186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:29.441536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:29.442670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 605/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 22 12:19:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:29.448616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:29.503164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:29.558206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2e727-a5f7-45aa-bd65-15e1628286bb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:29.595530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:29.596198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:29.596474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:29.596743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:29.597507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:29.597806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:29.599262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:29.608117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 631/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 22 12:19:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:29.615176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:29.715578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:29.734458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8793c-60be-44a1-bf61-548256e15d65 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:29.774952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:29.775751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:29.776084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:29.776419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:29.787754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:29.789403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:29.805222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:29.806603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:29.807530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:29.807530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:29.807530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:29.807530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 606/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:19:29.812926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:29.930163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f665b-0f9d-4f83-83ee-09934b7c46b3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:29.939234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:29.965512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:29.966827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:29.967125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:29.967490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:29.968339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:29.968758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:29.970677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:29.984944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 632/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:29.991004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:30.096689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b18e85-7204-43b3-bacc-9900ea6a0dbe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:30.132686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:30.133402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:30.133686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:30.133960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:30.137086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:30.143055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:30.144672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:19:30.157064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:30.158005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:30.158953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 607/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:19:30.164302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:30.274676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f57183-59bc-4337-b79d-79131116fd8f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:30.315421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:30.316289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:30.316633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:30.316991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:30.318039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:30.318353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:30.319783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:30.338629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 633/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 22 12:19:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:30.344687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:30.446324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76982ef3-d1d0-4613-ae2d-2cf66a9c4974 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:30.482658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:30.483269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:30.483549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:30.483821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:30.545860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:30.554331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:30.556295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:30.662128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 608/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:19:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:19:30.668726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:30.700319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:30.786905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7020f-ed56-4f39-afaf-17c56a232508 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:30.823270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:30.823831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:30.824175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:30.824446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:30.835850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:30.837412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:30.853708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:30.855025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:30.856143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:30.856143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:30.856143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:30.856143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 634/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:30.860948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:30.967829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:30.975015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a340a3-25e2-40b6-b659-fa7f94e1ab84 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:31.014892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:31.016222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:31.016521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:31.016806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:31.017473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:31.017758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:31.019123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:31.030400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 609/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:31.036321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:31.122534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:31.145630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998f8f-b719-4a83-9d70-f2fb95eb8d75 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:31.180008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996227-1c16-450d-9573-d327a92c442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:31.180715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996227-1c16-450d-9573-d327a92c442e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:31.181076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996227-1c16-450d-9573-d327a92c442e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:31.181353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996227-1c16-450d-9573-d327a92c442e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:31.189826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16996227-1c16-450d-9573-d327a92c442e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:31.191483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16996227-1c16-450d-9573-d327a92c442e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-16996227-1c16-450d-9573-d327a92c442e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:19:31.207611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:31.208839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:31.209902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 635/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:31.214620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:31.329655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9528979-a5bd-4537-8281-abeb899bb29d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:31.369266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:31.369941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:31.370316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:31.370678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:31.371561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:31.371901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:31.373695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08187210-f4ff-45fd-b02e-bab7004e6870 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:31.391600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 610/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:31.398262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996227-1c16-450d-9573-d327a92c442e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:31.512155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996227-1c16-450d-9573-d327a92c442e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:31.553702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:31.554314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:31.554730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:31.555119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:31.556003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] RBAC: Adding query filter params (role.id=3232592d86b145d1889de54a518e3fed, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=18dcb13de7d84c88bf32e41e103f7e8c) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:31.556318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:31.558475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bc700-2e71-4b69-a05c-23713dbda4a0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:31.565051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 636/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:19:31 2022] GET /identity/v3/role_assignments?user.id=18dcb13de7d84c88bf32e41e103f7e8c&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=3232592d86b145d1889de54a518e3fed => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:33.832583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f119e-a16d-4ee4-bbd2-dd5ca6ed1990 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:33.833243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f119e-a16d-4ee4-bbd2-dd5ca6ed1990 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:33.833243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f119e-a16d-4ee4-bbd2-dd5ca6ed1990 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:33.834476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 611/1247] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:33.839887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:33.840458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:33.840646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:33.847526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:33.861090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:33.862267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:33.944422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 637/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:34.219616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f119e-a16d-4ee4-bbd2-dd5ca6ed1990 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:34.239100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:34.327580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f119e-a16d-4ee4-bbd2-dd5ca6ed1990 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:34.367141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:34.367922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:34.368230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:34.368642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:34.381808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:19:34.389073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:34.390304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:34.391487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 612/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:34.397810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:34.505550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb51e9-eef0-4d77-b2c1-0e7ac8f5f12f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:34.536681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:34.542611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:34.543451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:34.544042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:34.544388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:34.545166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:34.545533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:34.546942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:34.554986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 638/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:19:34.561513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:34.647339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:34.673569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445aa14-635d-46c5-8698-e7b71a6335a1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:34.718816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:34.719440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:34.719724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:34.720064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:34.731465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:34.733446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:34.749185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:34.750305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:34.751440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:34.751440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:34.751440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:34.751440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 613/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 12:19:34.758221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:34.865662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef705c-b7b4-4fd9-8a8d-5f31f14d63f9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:34.910072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:34.910733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:34.911003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:34.911279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:34.911954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:34.912295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:34.913932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:34.929290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 639/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:34.936390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:35.043796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14326131-650f-497f-8b34-dc78c8ddb740 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:35.073146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:35.081837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:35.082605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:35.082886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:35.083218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:35.091150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:35.093274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:19:35.106002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:35.113171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:35.114452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 614/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:35.115235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:35.178501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:35.229837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94ae3-9c32-48b7-9685-8fc0e5fc0921 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:35.266650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:35.267265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:35.267544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:35.267811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:35.268575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:35.268890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:35.270326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:35.289046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 640/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 22 12:19:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:19:35.296069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:35.402309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f389e85-3ce1-4b1d-a8c1-c9c351dd48e3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:35.440109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:35.440719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:35.441000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:35.441298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:35.505666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:35.520936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:35.522412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:35.624751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 615/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:19:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:19:35.631104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:35.733445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9f83-f34f-4749-8ded-ceb104e66b1a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:35.746998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:35.769507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:35.770156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:35.770429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:35.770694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:35.782008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:35.783465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:35.799438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:35.800721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:35.801999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:35.801999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:35.801999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:35.801999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 641/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:35.806519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:35.909836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:35.924973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b17f8-9d5d-4e9b-bddf-db16b8b5d3ae None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:35.961565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:35.962192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:35.962446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:35.962721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:35.963367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:35.963672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:35.965079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:35.977238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 616/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:35.983523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:36.082975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c4244-0b2d-47fb-8e0a-ed777eb99617 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:36.117796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:36.118431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:36.118709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:36.119007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:36.125771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:36.127209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:19:36.138967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:36.140093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:36.141135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:36.141667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 642/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:36.149784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:36.250346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f418be-3770-408d-9a7b-cd522b595a2d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:36.281698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:36.282292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:36.282569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:36.282838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:36.283512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:36.283814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:36.285250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c41518-caa5-43d8-9a98-e1af51b488a4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:36.297090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 617/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:36.303077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:36.328499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:36.398854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3fbec-b12a-4aab-89f9-7fc6dc109b47 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:36.430310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:36.430889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:36.431163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:36.431429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:36.432163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=18dcb13de7d84c88bf32e41e103f7e8c) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:36.432467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:36.433865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dccdba-b4c3-4dc6-bc8b-871f4ef6b07b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:36.439495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 643/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:19:36 2022] GET /identity/v3/role_assignments?user.id=18dcb13de7d84c88bf32e41e103f7e8c&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=972430f30d6d40b1b22793c8952f489e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:38.591000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc75e-a145-42d4-98d4-50ec76bd1819 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:38.591518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc75e-a145-42d4-98d4-50ec76bd1819 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:38.591518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccc75e-a145-42d4-98d4-50ec76bd1819 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:38.593400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 618/1261] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:38.598682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:38.599079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:38.599222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:38.616816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:38.617976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:38.681016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 644/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:38.950564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccc75e-a145-42d4-98d4-50ec76bd1819 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:38.961998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:39.049225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccc75e-a145-42d4-98d4-50ec76bd1819 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:39.081842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:39.082455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:39.082731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:39.083000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:39.092668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:19:39.097401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:39.098461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:39.099507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 619/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:39.104437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:39.121866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:39.199269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc74968-2e72-41d4-bb78-aa67eb8f7110 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:39.234065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:39.234602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:39.234882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:39.235155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:39.235814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:39.236141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:39.237503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:39.245269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 645/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:39.251612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:39.321233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:39.352600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8768394-c6c8-493b-8501-cde89cd94f81 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:39.385594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:39.386213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:39.386491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:39.386762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:39.397487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:39.399150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:39.415809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:39.417004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:39.418018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:39.418018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:39.418018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:39.418018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 620/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:39.423257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:39.502075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:39.521058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f6be7-77e5-4e77-8418-fcac697cff49 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:39.553237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:39.553848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:39.554122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:39.554391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:39.555021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:39.555319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:39.556689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:39.568397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 646/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:39.573993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:39.671705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68db62-3473-4e3d-9156-6c8a54e8afbe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:39.690839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:39.706952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:39.708100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:39.708470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:39.708751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:39.716704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:39.718648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:19:39.729611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:39.730672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:39.731657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 621/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:39.737107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:39.832668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296c1e-1e34-489f-988d-47bc5c2019f0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:39.866393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:39.867366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:39.867742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:39.868166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:39.869280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:39.869687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:39.871686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:39.882811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:39.895644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 647/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 22 12:19:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:39.903008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:39.999320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a368b83-9624-4327-9fe8-aefc1ed07e02 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:40.032132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:40.032764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:40.033027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:40.033302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:40.043280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:40.044737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:40.058334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:40.059397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:40.060695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:40.060695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:40.060695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:40.060695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 622/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:40.064960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:40.160798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804310e9-c292-4660-9e8a-8cace0ace6a4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:40.193061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:40.193665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:40.193938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:40.194202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:40.194833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:40.195136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:40.196524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:40.208351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 648/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:19:40.213976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:40.245708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:40.312806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a198e-483b-44fc-a9de-7d420c93117b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:40.344981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:40.345595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:40.345870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:40.346140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:40.352445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:40.353868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:19:40.364771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:40.365777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:40.367019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 623/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:40.371664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:40.428153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:40.469711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e5b02-cd27-4a1d-a650-988323f035ea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:40.501721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:40.502314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:40.502591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:40.502861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:40.503539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:40.503842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:40.505330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149498c-8c3e-48e5-aec5-54f2b29f5bf3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:40.516999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 649/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:19:40.522794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:40.610463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:40.619326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295e849-eb16-4747-9b2c-968ba504ac8d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:40.651075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5a69e-edd8-4d80-9f98-53840ae1e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:40.651710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a69e-edd8-4d80-9f98-53840ae1e444 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:40.652016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a69e-edd8-4d80-9f98-53840ae1e444 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:40.652298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a69e-edd8-4d80-9f98-53840ae1e444 None admin] PATH_INFO: `/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/18dcb13de7d84c88bf32e41e103f7e8c/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:40.654143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5a69e-edd8-4d80-9f98-53840ae1e444 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ed0b1ca02e24a7f8f5e448387448e25, user_id=18dcb13de7d84c88bf32e41e103f7e8c, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:40.656107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5a69e-edd8-4d80-9f98-53840ae1e444 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:40.667904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 624/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 22 12:19:40 2022] PUT /identity/v3/projects/0ed0b1ca02e24a7f8f5e448387448e25/users/18dcb13de7d84c88bf32e41e103f7e8c/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:19:42.794442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e039ac7-9d24-4843-8a56-2faf41fb07c3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:42.794999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e039ac7-9d24-4843-8a56-2faf41fb07c3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:42.794999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e039ac7-9d24-4843-8a56-2faf41fb07c3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:42.796332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 650/1274] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:42.801380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:42.801749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:42.801930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:42.820103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:42.821279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:42.889955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 625/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:43.163706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e039ac7-9d24-4843-8a56-2faf41fb07c3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:43.264048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e039ac7-9d24-4843-8a56-2faf41fb07c3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:43.282098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:43.299619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:43.300276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:43.300554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:43.300823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:43.310560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 12:19:43.315913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:43.317021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:43.317913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 651/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 22 12:19:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:43.323024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:43.399504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:43.417560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d47027-834c-46ac-8bc0-3db7f8bc7787 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:43.449636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:43.450226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:43.450502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:43.450768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:43.451442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:43.451741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:43.453350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:43.462363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 626/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 22 12:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:43.468721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:43.564677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6501b-85c8-4778-9c6c-eff34cdeef1e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:43.597108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:43.597721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:43.598004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:43.598280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:43.608577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:43.610006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:43.624087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:43.625237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:43.626338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:43.626338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:43.626338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:43.626338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 652/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:43.632295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:43.728528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa1b8-dc09-4452-a675-fdc27b44da72 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:43.760138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:43.760733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:43.761012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:43.761284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:43.761912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:43.762213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:43.763566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:43.775277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 627/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:43.781369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:43.813244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:43.883131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce870a2-0b8b-4bb2-9de4-68e3ad7cf71e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:43.916496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:43.917119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:43.917399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:43.917673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:43.924812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:43.926237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 12:19:43.937102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:43.938205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:43.939134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 653/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:43.944040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:43.947780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:44.041564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef31ea-2190-4a06-bcbd-629233c60996 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:44.073891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:44.074488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:44.074771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:44.075048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:44.075763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:44.076102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:44.078129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:44.094421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 628/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 22 12:19:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:44.099826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:44.190223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:44.203021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353c6a3-f0b9-4feb-92f4-eec34598e0d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:44.235485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:44.236116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:44.236390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:44.236655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:44.300992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:44.302359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:44.387557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:44.398427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 654/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 22 12:19:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 12:19:44.404236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:44.463025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:44.500824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ffb0-6a74-4cca-b37d-232c4726b8fe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:44.534246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:44.534873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:44.535153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:44.535427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:44.545083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:44.547023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 12:19:44.561659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:44.562775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 12:19:44.563986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 12:19:44.563986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 12:19:44.563986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:44.563986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 629/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:44.568384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:44.665189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfab0f-b250-46c1-a427-4c94ec78455b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:44.698603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:44.699209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:44.699484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:44.699755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:44.700422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:44.700723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:44.702103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:44.712868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 655/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 22 12:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:44.718684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:44.817616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd1a7b-7885-419d-bebb-25a7b2fd1eef None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:44.830991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:44.851651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:44.852304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:44.852599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:44.852859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:44.859891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:44.861349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 12:19:44.872782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:44.874034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Sep 22 12:19:44.875095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 630/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 22 12:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:44.880376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:44.931785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:44.980053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbf904-c0d1-49da-86e2-af5176d5292b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:45.014128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:45.014734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:45.015089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:45.015356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:45.016077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:45.016381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:45.017793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04d47f-667f-4bb2-83f8-52764e9972c0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:45.030218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 656/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 22 12:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:45.036378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:45.136613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bb12c-278d-4445-aaf1-6c06d617e81e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:45.168833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:45.169429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:45.169708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:45.169983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:45.171325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] RBAC: Adding query filter params (role.id=972430f30d6d40b1b22793c8952f489e, scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25, user.id=18dcb13de7d84c88bf32e41e103f7e8c) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:45.171632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:45.173086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37e93-2f73-4c54-8be3-1db6726751a0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:45.178655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 631/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 22 12:19:45 2022] GET /identity/v3/role_assignments?user.id=18dcb13de7d84c88bf32e41e103f7e8c&scope.project.id=0ed0b1ca02e24a7f8f5e448387448e25&role.id=972430f30d6d40b1b22793c8952f489e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:47.336957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b29698-83d6-4b8b-b8ff-1eddc2f50a00 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:47.337471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b29698-83d6-4b8b-b8ff-1eddc2f50a00 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:47.337471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b29698-83d6-4b8b-b8ff-1eddc2f50a00 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:47.338816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 657/1288] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:47.343999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:47.344414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:47.344544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:47.362414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:47.363588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:47.393259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:47.430133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 632/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:47.694993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b29698-83d6-4b8b-b8ff-1eddc2f50a00 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:47.813682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b29698-83d6-4b8b-b8ff-1eddc2f50a00 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:47.825081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:47.847953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:47.848576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:47.848850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:47.849114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:47.849683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:47.851021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:47.860164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:47.861374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:47.862406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 658/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:19:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:47.867282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:47.969178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ab007-02b6-4b3a-8e43-866fe8bbf0ab None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:48.001477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:48.002100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:48.002377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:48.002649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:48.003270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:48.003572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:48.004959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a633a-6750-4ec4-b82b-13aaf6335572 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:48.009795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 633/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 22 12:19:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:48.015500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:48.118153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37dbf6-1756-4f70-a0bc-a20b6f23d1fe None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:48.149725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:48.150317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:48.150592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:48.150859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:48.151472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:48.151770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:48.153142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d23e-899e-4e49-a4ff-fccdd8d52ce2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:48.157843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 659/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 22 12:19:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:50.295317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7128-66ee-46cf-a68e-f5544e30470a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:50.295853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7128-66ee-46cf-a68e-f5544e30470a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:50.295853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7128-66ee-46cf-a68e-f5544e30470a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:50.297221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 634/1293] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:50.302315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1df0-be9b-405e-b6f9-a2b34eaee4a7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:50.302696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1df0-be9b-405e-b6f9-a2b34eaee4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:50.302867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1df0-be9b-405e-b6f9-a2b34eaee4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:50.321251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-de5a1df0-be9b-405e-b6f9-a2b34eaee4a7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:50.322429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-de5a1df0-be9b-405e-b6f9-a2b34eaee4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:50.351207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:50.388918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 660/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:50.661253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7128-66ee-46cf-a68e-f5544e30470a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:50.692346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:50.764089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7128-66ee-46cf-a68e-f5544e30470a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:50.796354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2a3b8-76ff-4119-87d6-26a61cb8c972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:50.796951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a3b8-76ff-4119-87d6-26a61cb8c972 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:50.797234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a3b8-76ff-4119-87d6-26a61cb8c972 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:50.797509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a3b8-76ff-4119-87d6-26a61cb8c972 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:50.798154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a3b8-76ff-4119-87d6-26a61cb8c972 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:50.799511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a3b8-76ff-4119-87d6-26a61cb8c972 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:50.813837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 635/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 22 12:19:50 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:19:52.928012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ed59f-9149-4c70-8ed1-b76cc1a85943 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:52.928742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ed59f-9149-4c70-8ed1-b76cc1a85943 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:52.928742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ed59f-9149-4c70-8ed1-b76cc1a85943 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:52.930023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 661/1296] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:52.936558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:52.936964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:52.937237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:52.955412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:52.956638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:53.026811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 636/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 12:19:53.297724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ed59f-9149-4c70-8ed1-b76cc1a85943 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:53.396859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ed59f-9149-4c70-8ed1-b76cc1a85943 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:53.428964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:53.429575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:53.429851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:53.430120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:53.430687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:53.432061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:53.441324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:53.442530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:53.443467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 662/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:19:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:53.448601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:53.468992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:53.556110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67a93-8088-4849-ac22-52999c7890fb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:53.588148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:53.588745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:53.589020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:53.589289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:53.589902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:53.590198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:53.591547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:53.596505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 637/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 22 12:19:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:53.602489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:53.633982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:53.699378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64547701-bacc-4904-84a5-1aa6c5945e0d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:53.730640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:53.731225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:53.731498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:53.731765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:53.732477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] RBAC: Adding query filter params (interface=public, service_id=ff6a1a7086184de2b322bc36edf655ca, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:53.732778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:53.734627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc04ef-6bc4-4e65-8781-b5155a339157 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:53.739357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 663/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 22 12:19:53 2022] GET /identity/v3/endpoints?service_id=ff6a1a7086184de2b322bc36edf655ca&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:53.744821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:53.826711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:53.844553 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcbb6f-b4ab-4f80-aa18-a524ea3dee49 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:53.877810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770536-95f5-4550-8a46-33bf73481f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:53.878416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770536-95f5-4550-8a46-33bf73481f34 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:53.878694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770536-95f5-4550-8a46-33bf73481f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:53.878963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770536-95f5-4550-8a46-33bf73481f34 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:53.879559 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770536-95f5-4550-8a46-33bf73481f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:53.880940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770536-95f5-4550-8a46-33bf73481f34 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:53.888157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 638/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 22 12:19:53 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:19:56.006901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdece91c-722c-489c-b7c1-d1d158c5b57f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:56.007710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdece91c-722c-489c-b7c1-d1d158c5b57f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:56.007710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdece91c-722c-489c-b7c1-d1d158c5b57f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:56.009074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 664/1302] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:19:56.014266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:56.015151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:56.015336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:56.033549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:19:56.034717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:19:56.098765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 639/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:19:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 12:19:56.361151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdece91c-722c-489c-b7c1-d1d158c5b57f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:56.453046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:56.459741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdece91c-722c-489c-b7c1-d1d158c5b57f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:56.491658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:56.492299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:56.492580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:56.492852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:56.493429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:56.494807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 12:19:56.503951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 12:19:56.505112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 22 12:19:56.506298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 665/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 22 12:19:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 12:19:56.511235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:56.582980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:19:56.604981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36378687-d811-47bf-9913-d0de5b5e0555 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:56.638033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:56.638626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:56.638906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:56.639175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:56.639819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:19:56.640151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:56.641498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ed9ed-2808-4a82-a641-6df483fe9250 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:56.646367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 640/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 22 12:19:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:19:56.651906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:19:56.746939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04722e-68bc-4e84-9c78-8af90d9c4000 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:19:56.779383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab6af-b949-4e57-b60a-f31d3a64dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:19:56.779990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab6af-b949-4e57-b60a-f31d3a64dba0 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:19:56.780296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab6af-b949-4e57-b60a-f31d3a64dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:19:56.780568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab6af-b949-4e57-b60a-f31d3a64dba0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:19:56.781221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab6af-b949-4e57-b60a-f31d3a64dba0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:19:56.782573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab6af-b949-4e57-b60a-f31d3a64dba0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:19:56.801576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 666/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:19:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:20:06.643500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=30 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:20:06.797331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:00.799799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34732-3b1a-4ef2-81d1-b7cbb7428062 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:00.800316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34732-3b1a-4ef2-81d1-b7cbb7428062 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:00.800492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34732-3b1a-4ef2-81d1-b7cbb7428062 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:00.807258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701951-2216-4744-a2d8-550aee0e35a4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:00.807675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701951-2216-4744-a2d8-550aee0e35a4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:00.807882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701951-2216-4744-a2d8-550aee0e35a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:00.810499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 641/1307] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:00.968097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dd701951-2216-4744-a2d8-550aee0e35a4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:00.969329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dd701951-2216-4744-a2d8-550aee0e35a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:01.148343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 667/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:21:01.424692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517390-575c-4f44-9b30-3ce31778f0b0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:01.425054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517390-575c-4f44-9b30-3ce31778f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:01.425240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46517390-575c-4f44-9b30-3ce31778f0b0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:01.426968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 642/1309] 10.222.0.25 () {54 vars in 964 bytes} [Thu Sep 22 12:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:01.433574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e71cf-e4ec-4c16-b268-1913ca772d8a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:01.433858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e71cf-e4ec-4c16-b268-1913ca772d8a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:01.434132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e71cf-e4ec-4c16-b268-1913ca772d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:01.531604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c22e71cf-e4ec-4c16-b268-1913ca772d8a None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:01.532875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c22e71cf-e4ec-4c16-b268-1913ca772d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:01.556414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:01.621186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 668/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Sep 22 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:01.631020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517390-575c-4f44-9b30-3ce31778f0b0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:01.632940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-46517390-575c-4f44-9b30-3ce31778f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:01.760069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46517390-575c-4f44-9b30-3ce31778f0b0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:01.853019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:01.853786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:01.854138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:01.854480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:01.856450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:01.919230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:01.981677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:01.983302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e187ec8-a8d6-4329-8714-0aae25002956 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:02.005623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 643/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:04.533452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4918-5434-49c7-b7ea-2b4f5dbd00ee None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:04.534111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4918-5434-49c7-b7ea-2b4f5dbd00ee None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:04.534111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4918-5434-49c7-b7ea-2b4f5dbd00ee None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:04.535528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 669/1312] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:04.540827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e646c-5e31-4f3c-b97f-8951eba51caa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:04.541245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e646c-5e31-4f3c-b97f-8951eba51caa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:04.541409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e646c-5e31-4f3c-b97f-8951eba51caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:04.611238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8e2e646c-5e31-4f3c-b97f-8951eba51caa None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:04.612482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8e2e646c-5e31-4f3c-b97f-8951eba51caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:04.706150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 644/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:05.000489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce33de-811f-4f5f-9b1f-9edfc79d91b4 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:05.000776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce33de-811f-4f5f-9b1f-9edfc79d91b4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:05.001052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce33de-811f-4f5f-9b1f-9edfc79d91b4 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:05.002409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 670/1314] 10.222.0.25 () {54 vars in 964 bytes} [Thu Sep 22 12:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:05.008857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c9c6-00c7-4e0f-88d8-0045a4b85469 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:05.009144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c9c6-00c7-4e0f-88d8-0045a4b85469 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:05.009420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c9c6-00c7-4e0f-88d8-0045a4b85469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:05.021183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:05.084123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c004c9c6-00c7-4e0f-88d8-0045a4b85469 None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:05.085316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c004c9c6-00c7-4e0f-88d8-0045a4b85469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:05.157854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 645/1315] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Sep 22 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:05.167448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce33de-811f-4f5f-9b1f-9edfc79d91b4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:05.169034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-abce33de-811f-4f5f-9b1f-9edfc79d91b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:05.272013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce33de-811f-4f5f-9b1f-9edfc79d91b4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:05.343095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:05.345585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:05.346849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:05.347332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:05.347657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:05.349430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:05.454363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:05.456316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14ec5c-c435-4a27-9f3e-f0870d30c5b0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:05.474423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 671/1316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:08.140711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390a6b7-3045-4d39-9a0d-9055dd2bc608 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:08.141279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390a6b7-3045-4d39-9a0d-9055dd2bc608 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:08.141279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390a6b7-3045-4d39-9a0d-9055dd2bc608 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:08.142583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 646/1317] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:08.147926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ef34-6496-4e13-b642-15949796f6c3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:08.148400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ef34-6496-4e13-b642-15949796f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:08.148519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8ef34-6496-4e13-b642-15949796f6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:08.212968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2ce8ef34-6496-4e13-b642-15949796f6c3 None None] MFA Rules not processed for user `605f457b5dee4da089b04c3cf70f8345`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:08.214164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2ce8ef34-6496-4e13-b642-15949796f6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:08.264964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:08.310465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 672/1318] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:08.592320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390a6b7-3045-4d39-9a0d-9055dd2bc608 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:08.593844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9390a6b7-3045-4d39-9a0d-9055dd2bc608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:08.693623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390a6b7-3045-4d39-9a0d-9055dd2bc608 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:08.696373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:08.765266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:08.765794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:08.766069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:08.766338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:08.767888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:08.879098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:08.880598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21adf-c94e-4c5e-a075-89bd7afa1df2 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:08.899108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 647/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:11.574967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf829e-b545-4744-9c06-ab7ab331b8b2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:11.575502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf829e-b545-4744-9c06-ab7ab331b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:11.575502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf829e-b545-4744-9c06-ab7ab331b8b2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:11.576794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 673/1320] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:11.582561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1451-e054-4cfd-933a-beb95692a181 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:11.582985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1451-e054-4cfd-933a-beb95692a181 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:11.583096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1451-e054-4cfd-933a-beb95692a181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:11.622569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:11.649876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-977f1451-e054-4cfd-933a-beb95692a181 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:11.651075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-977f1451-e054-4cfd-933a-beb95692a181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:11.743807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 648/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:12.031543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf829e-b545-4744-9c06-ab7ab331b8b2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:12.033143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21cf829e-b545-4744-9c06-ab7ab331b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:12.134797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf829e-b545-4744-9c06-ab7ab331b8b2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:12.211149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:12.211752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:12.212058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:12.212326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:12.213886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:12.220600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:12.320241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:12.321577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998742-6c15-407d-87d9-8eb637d9d5d8 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:12.339636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 674/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:15.109689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686aa5-ffc7-493d-b9c7-d9d04d3a1b22 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:15.110272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686aa5-ffc7-493d-b9c7-d9d04d3a1b22 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:15.110272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686aa5-ffc7-493d-b9c7-d9d04d3a1b22 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:15.111568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 649/1323] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:15.117420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90582-68e6-4e1b-a7bc-f9a8e11fd7fe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:15.117834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90582-68e6-4e1b-a7bc-f9a8e11fd7fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:15.117974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90582-68e6-4e1b-a7bc-f9a8e11fd7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:15.192039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-72f90582-68e6-4e1b-a7bc-f9a8e11fd7fe None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:15.193290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-72f90582-68e6-4e1b-a7bc-f9a8e11fd7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:15.255678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:15.298946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 675/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:15.575146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686aa5-ffc7-493d-b9c7-d9d04d3a1b22 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:15.576782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-13686aa5-ffc7-493d-b9c7-d9d04d3a1b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:15.676871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686aa5-ffc7-493d-b9c7-d9d04d3a1b22 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:15.689369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:15.749555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:15.750149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:15.750420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:15.750683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:15.752266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:15.858533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:15.859879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed7209-b535-474a-ac5e-650f89d8cf93 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:15.877964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 650/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:18.061309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02ebc9-4a0f-41c2-bcb7-1aa4631cc245 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:18.061836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02ebc9-4a0f-41c2-bcb7-1aa4631cc245 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:18.061983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02ebc9-4a0f-41c2-bcb7-1aa4631cc245 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:18.063361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 676/1326] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:18.068826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8dee-b37c-4349-838b-2f6f40fdc6bc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:18.069241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8dee-b37c-4349-838b-2f6f40fdc6bc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:18.069393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8dee-b37c-4349-838b-2f6f40fdc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:18.117796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:18.136218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-68bc8dee-b37c-4349-838b-2f6f40fdc6bc None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:18.137408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-68bc8dee-b37c-4349-838b-2f6f40fdc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:18.241013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 651/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:18.518433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02ebc9-4a0f-41c2-bcb7-1aa4631cc245 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:18.520583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1c02ebc9-4a0f-41c2-bcb7-1aa4631cc245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:18.623637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02ebc9-4a0f-41c2-bcb7-1aa4631cc245 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:18.696022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:18.696626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:18.696899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:18.697164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:18.698736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:18.716437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:18.810715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:18.812076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3a190-dde7-4f6d-af1a-c37d9e3eb4f7 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:18.830421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 677/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:21.046413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fafb9-39cc-4e30-8625-7a220497145d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:21.046926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fafb9-39cc-4e30-8625-7a220497145d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:21.047040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fafb9-39cc-4e30-8625-7a220497145d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:21.048372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 652/1329] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:21.054187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6638853-d9f5-456c-a18a-95adc0b4b519 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:21.054618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6638853-d9f5-456c-a18a-95adc0b4b519 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:21.054715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6638853-d9f5-456c-a18a-95adc0b4b519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:21.125459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a6638853-d9f5-456c-a18a-95adc0b4b519 None None] MFA Rules not processed for user `605f457b5dee4da089b04c3cf70f8345`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:21.126674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a6638853-d9f5-456c-a18a-95adc0b4b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:21.200217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:21.233229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 678/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:21.516612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fafb9-39cc-4e30-8625-7a220497145d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:21.518147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-822fafb9-39cc-4e30-8625-7a220497145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:21.623607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fafb9-39cc-4e30-8625-7a220497145d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:21.644994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:21.697601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:21.698127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:21.698402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:21.698667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:21.700272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:21.808779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:21.810224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67499a2-e7aa-4d51-b445-48c855242ca4 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:21.828821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 653/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:21:24.414016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ee2e-c944-4788-abaa-930cb487d5f0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:24.414567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ee2e-c944-4788-abaa-930cb487d5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:24.414567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ee2e-c944-4788-abaa-930cb487d5f0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:24.415925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 679/1332] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:24.421325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2310-22d7-48e3-a0a9-2c683dd6bc5d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:24.421780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2310-22d7-48e3-a0a9-2c683dd6bc5d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:24.421888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2310-22d7-48e3-a0a9-2c683dd6bc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:24.485532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:24.488307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-268f2310-22d7-48e3-a0a9-2c683dd6bc5d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:24.490432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-268f2310-22d7-48e3-a0a9-2c683dd6bc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:24.589588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 654/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:24.872906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ee2e-c944-4788-abaa-930cb487d5f0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:24.874468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-70d4ee2e-c944-4788-abaa-930cb487d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:24.976491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ee2e-c944-4788-abaa-930cb487d5f0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:25.047985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:25.048584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:25.048860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:25.049121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:25.052012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:25.078900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:25.159173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:25.160645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d8330-7e2b-43c8-b911-9f7b287c4353 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:25.178734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 680/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:27.362259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404a5d-26c0-4037-9661-eab2fbd15326 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:27.362788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404a5d-26c0-4037-9661-eab2fbd15326 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:27.362869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31404a5d-26c0-4037-9661-eab2fbd15326 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:27.364214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 655/1335] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:27.369598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146a85-41ef-4bff-a3d4-9fea20d392b2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:27.370021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146a85-41ef-4bff-a3d4-9fea20d392b2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:27.370148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146a85-41ef-4bff-a3d4-9fea20d392b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:27.436281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b9146a85-41ef-4bff-a3d4-9fea20d392b2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:27.437499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b9146a85-41ef-4bff-a3d4-9fea20d392b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:27.514420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:27.538102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 681/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:27.824514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31404a5d-26c0-4037-9661-eab2fbd15326 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:27.826040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-31404a5d-26c0-4037-9661-eab2fbd15326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:27.929032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31404a5d-26c0-4037-9661-eab2fbd15326 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:27.956741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:28.000904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:28.001495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:28.001770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:28.002037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:28.003596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:28.110589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:28.111956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a38ea-f3cf-408e-866a-c8d79b4044ba service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:28.130992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 656/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:30.729393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbc568-4803-4afc-865f-b235352101e8 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:30.729932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbc568-4803-4afc-865f-b235352101e8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:30.729932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbc568-4803-4afc-865f-b235352101e8 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:30.731201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 682/1338] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:30.736250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc1fe9-ae04-48f3-adba-b67a1a6d688a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:30.736653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc1fe9-ae04-48f3-adba-b67a1a6d688a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:30.736793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc1fe9-ae04-48f3-adba-b67a1a6d688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:30.800134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-aabc1fe9-ae04-48f3-adba-b67a1a6d688a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:30.801333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aabc1fe9-ae04-48f3-adba-b67a1a6d688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:30.809301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:30.896246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 657/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:31.178825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbc568-4803-4afc-865f-b235352101e8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:31.180384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c0cbc568-4803-4afc-865f-b235352101e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:31.281921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbc568-4803-4afc-865f-b235352101e8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:31.354128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:31.354730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:31.355008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:31.355284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:31.356889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:31.392109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:31.463559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:31.465009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf1f3d-eaef-4a28-9785-dd0dc4665c35 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:31.483221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 683/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:35.647381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401b341-7710-4e49-a873-8c846501f5d7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:35.647991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401b341-7710-4e49-a873-8c846501f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:35.647991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401b341-7710-4e49-a873-8c846501f5d7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:35.649348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 658/1341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:35.654635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679be1-00a9-4546-afbc-31df8d4bcbb2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:35.655092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679be1-00a9-4546-afbc-31df8d4bcbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:35.655197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed679be1-00a9-4546-afbc-31df8d4bcbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:35.720316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ed679be1-00a9-4546-afbc-31df8d4bcbb2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:35.721520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ed679be1-00a9-4546-afbc-31df8d4bcbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:35.806099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:35.817950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 684/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:36.100806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401b341-7710-4e49-a873-8c846501f5d7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:36.102370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b401b341-7710-4e49-a873-8c846501f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:36.207047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401b341-7710-4e49-a873-8c846501f5d7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:36.248169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:36.284018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:36.284649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:36.284924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:36.285192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:36.287435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:36.394261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:36.396795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4619fe-3776-4df4-a0db-9d40660683bf service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:36.415814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 659/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:39.225051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277eef1-227d-4376-a9c1-63ee1d4d299c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:39.225561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277eef1-227d-4376-a9c1-63ee1d4d299c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:39.225667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277eef1-227d-4376-a9c1-63ee1d4d299c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:39.226978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 685/1344] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:39.232331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ffa3-6099-4ca4-adca-2fcd82951928 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:39.232757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ffa3-6099-4ca4-adca-2fcd82951928 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:39.233032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2ffa3-6099-4ca4-adca-2fcd82951928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:39.298017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fde2ffa3-6099-4ca4-adca-2fcd82951928 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:39.299224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fde2ffa3-6099-4ca4-adca-2fcd82951928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:39.316703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:39.396424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 660/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:39.681779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277eef1-227d-4376-a9c1-63ee1d4d299c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:39.683340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e277eef1-227d-4376-a9c1-63ee1d4d299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:39.792701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277eef1-227d-4376-a9c1-63ee1d4d299c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:39.867752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:39.868386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:39.868665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:39.868938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:39.870527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:39.917320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:40.003006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:40.005132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84071cc-20c8-48bf-990a-e0b826d7c86e service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:40.024025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 686/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:44.128609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec394-3d8a-40ea-91a1-be01445a947e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:44.129091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec394-3d8a-40ea-91a1-be01445a947e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:44.129208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec394-3d8a-40ea-91a1-be01445a947e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:44.131202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 661/1347] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:44.136605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e344d-e723-4057-8bf4-7abc565cf0f5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:44.137004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e344d-e723-4057-8bf4-7abc565cf0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:44.137141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e344d-e723-4057-8bf4-7abc565cf0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:44.203658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-296e344d-e723-4057-8bf4-7abc565cf0f5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:44.204913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-296e344d-e723-4057-8bf4-7abc565cf0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:44.297852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:44.300317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 687/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:44.583357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec394-3d8a-40ea-91a1-be01445a947e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:21:44.584991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eefec394-3d8a-40ea-91a1-be01445a947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:44.689444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec394-3d8a-40ea-91a1-be01445a947e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:21:44.744477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:44.773340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:21:44.773949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:44.774228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:44.774497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:44.776115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:44.887699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:21:44.889208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b6091-64c8-4625-941f-b422951af227 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:21:44.907860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 662/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:21:49.842466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb326-fcf3-465f-bcd1-f14e23052ba9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:49.843422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb326-fcf3-465f-bcd1-f14e23052ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:49.843865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb326-fcf3-465f-bcd1-f14e23052ba9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:49.845631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 688/1350] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:49.851336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23692-1190-443c-89eb-77955924f61a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:49.852124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23692-1190-443c-89eb-77955924f61a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:49.852570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23692-1190-443c-89eb-77955924f61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:49.938613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6ba23692-1190-443c-89eb-77955924f61a None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:49.939923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6ba23692-1190-443c-89eb-77955924f61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:49.964385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:50.101245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 663/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:54.352443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee482b-41fc-436c-8fe5-50c76c11397d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:54.353330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee482b-41fc-436c-8fe5-50c76c11397d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:54.353600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee482b-41fc-436c-8fe5-50c76c11397d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:54.355243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 689/1352] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:54.359865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08915adc-4bec-4fb3-a731-c7fa649651cf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:54.360341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08915adc-4bec-4fb3-a731-c7fa649651cf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:54.360688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08915adc-4bec-4fb3-a731-c7fa649651cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:54.441269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-08915adc-4bec-4fb3-a731-c7fa649651cf None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:54.442634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-08915adc-4bec-4fb3-a731-c7fa649651cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:54.516902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:54.557026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 664/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:21:55.842385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60890cb-63a8-4e11-9792-16f6a3fde017 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:55.842920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60890cb-63a8-4e11-9792-16f6a3fde017 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:55.842920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60890cb-63a8-4e11-9792-16f6a3fde017 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:55.844285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 690/1354] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:55.849152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247037-5e35-48c6-b3da-d9bbf76d88dc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:55.849580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247037-5e35-48c6-b3da-d9bbf76d88dc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:55.849705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247037-5e35-48c6-b3da-d9bbf76d88dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:55.928377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d1247037-5e35-48c6-b3da-d9bbf76d88dc None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:55.929577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d1247037-5e35-48c6-b3da-d9bbf76d88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:56.033497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 665/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:21:59.705676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63990a-7bff-4150-add6-ee164c8e7a75 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:59.706134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63990a-7bff-4150-add6-ee164c8e7a75 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:59.706230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63990a-7bff-4150-add6-ee164c8e7a75 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:59.707570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 691/1356] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:21:59.713812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14973c1-ce37-4e44-881a-69df3220c511 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:21:59.714304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14973c1-ce37-4e44-881a-69df3220c511 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:21:59.714388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14973c1-ce37-4e44-881a-69df3220c511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:21:59.753538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:59.789468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a14973c1-ce37-4e44-881a-69df3220c511 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:21:59.790703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a14973c1-ce37-4e44-881a-69df3220c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:21:59.895987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 666/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:00.210778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403055b3-fb43-4ef1-910e-3c08a75a12e2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:00.211309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403055b3-fb43-4ef1-910e-3c08a75a12e2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:00.211593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403055b3-fb43-4ef1-910e-3c08a75a12e2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:00.213419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 692/1358] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 22 12:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:00.219845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab4597-a746-46c7-94be-d10f054e2fbc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:00.220661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab4597-a746-46c7-94be-d10f054e2fbc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:00.221118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab4597-a746-46c7-94be-d10f054e2fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:00.303545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e8ab4597-a746-46c7-94be-d10f054e2fbc None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:00.305281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e8ab4597-a746-46c7-94be-d10f054e2fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:00.357807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:00.431216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 667/1359] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 22 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:22:00.439041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403055b3-fb43-4ef1-910e-3c08a75a12e2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:00.440596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-403055b3-fb43-4ef1-910e-3c08a75a12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:00.596528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403055b3-fb43-4ef1-910e-3c08a75a12e2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:00.678481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:00.721391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:00.722019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:00.722344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:00.722679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:00.724907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:00.826207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:00.827902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0432c-6698-4ab2-80bf-375bf9bd1d9d service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:00.846909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 693/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:03.208471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4e42b-9b65-4435-880f-7611541fec8a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:03.209566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4e42b-9b65-4435-880f-7611541fec8a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:03.209675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4e42b-9b65-4435-880f-7611541fec8a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:03.210938 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 668/1361] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:03.216645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea84444-240c-4032-afe1-ab07f0826eac None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:03.217120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea84444-240c-4032-afe1-ab07f0826eac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:03.217120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea84444-240c-4032-afe1-ab07f0826eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:03.290733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9ea84444-240c-4032-afe1-ab07f0826eac None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:03.292023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9ea84444-240c-4032-afe1-ab07f0826eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:03.331408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:03.399403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 694/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:03.684688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4e42b-9b65-4435-880f-7611541fec8a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:03.686204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8ec4e42b-9b65-4435-880f-7611541fec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:03.856468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4e42b-9b65-4435-880f-7611541fec8a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:03.869535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:04.011916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:04.012560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:04.012835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:04.013104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:04.014746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:04.106697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:04.108445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb67607-c74b-4dc0-8b4a-5f75cab8af1a service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:04.126726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 669/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:06.672433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15389d-90a6-47fe-9fdb-bef1716c5236 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:06.673065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15389d-90a6-47fe-9fdb-bef1716c5236 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:06.673065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15389d-90a6-47fe-9fdb-bef1716c5236 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:06.674305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 695/1364] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:06.679596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884667-05ae-4b26-8bdf-3484fcf622dd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:06.680094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884667-05ae-4b26-8bdf-3484fcf622dd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:06.680211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884667-05ae-4b26-8bdf-3484fcf622dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:06.695976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:06.748351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-18884667-05ae-4b26-8bdf-3484fcf622dd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:06.749601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-18884667-05ae-4b26-8bdf-3484fcf622dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:06.856074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 670/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:07.148623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540591-5d4c-4c81-821d-87071f695839 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:07.148904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540591-5d4c-4c81-821d-87071f695839 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:07.149177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540591-5d4c-4c81-821d-87071f695839 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:07.150754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 696/1366] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 22 12:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:07.156156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca4ea1-1ffc-4495-8ac7-a94e8c8a2439 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:07.156443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca4ea1-1ffc-4495-8ac7-a94e8c8a2439 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:07.156719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca4ea1-1ffc-4495-8ac7-a94e8c8a2439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:07.242190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-87ca4ea1-1ffc-4495-8ac7-a94e8c8a2439 None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:07.243512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-87ca4ea1-1ffc-4495-8ac7-a94e8c8a2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:07.279616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:07.365310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 671/1367] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 22 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:07.373681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540591-5d4c-4c81-821d-87071f695839 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:07.375316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1f540591-5d4c-4c81-821d-87071f695839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:07.528623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540591-5d4c-4c81-821d-87071f695839 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:07.550145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:07.657718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:07.658329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:07.658611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:07.658890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:07.660532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:07.760010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:07.761700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc42f3-7a46-46d5-bdfc-a969d04db1fd service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:07.783188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 697/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:07.863023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23150c-96b6-4efb-ab6c-e72c3fc2a03a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:07.863589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23150c-96b6-4efb-ab6c-e72c3fc2a03a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:07.863589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23150c-96b6-4efb-ab6c-e72c3fc2a03a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:07.865215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 672/1369] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:07.871873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13837fd5-0b29-4759-8418-f9537543c34b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:07.872203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13837fd5-0b29-4759-8418-f9537543c34b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:07.872563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13837fd5-0b29-4759-8418-f9537543c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:07.918312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:07.973833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-13837fd5-0b29-4759-8418-f9537543c34b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:07.975749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-13837fd5-0b29-4759-8418-f9537543c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:08.101621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 698/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:08.399826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848aab3-843e-4a7e-ba93-86161bde1821 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:08.400183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848aab3-843e-4a7e-ba93-86161bde1821 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:08.400463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848aab3-843e-4a7e-ba93-86161bde1821 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:08.401949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 673/1371] 10.222.0.25 () {54 vars in 963 bytes} [Thu Sep 22 12:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:08.407316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ab66-813f-4ba2-b459-1537f21fa080 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:08.407601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ab66-813f-4ba2-b459-1537f21fa080 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:08.407876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ab66-813f-4ba2-b459-1537f21fa080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:08.489418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7f95ab66-813f-4ba2-b459-1537f21fa080 None None] MFA Rules not processed for user `fc7ee82e55b8416dbf41dd368cc435d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:08.491145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f95ab66-813f-4ba2-b459-1537f21fa080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:08.543196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:08.575554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 699/1372] 10.222.0.25 () {58 vars in 1060 bytes} [Thu Sep 22 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:08.585598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848aab3-843e-4a7e-ba93-86161bde1821 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:08.587348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7848aab3-843e-4a7e-ba93-86161bde1821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:08.702193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848aab3-843e-4a7e-ba93-86161bde1821 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:08.744221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:08.785186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:08.785868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:08.786267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:08.786636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:08.788439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:08.930762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:08.932817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e9d1b-e17a-4c2f-94c2-4d8b72cea8d4 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:08.958708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 674/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:10.071088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e10c-9849-4414-82fe-6689078ec4c3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:10.071614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e10c-9849-4414-82fe-6689078ec4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:10.071614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8e10c-9849-4414-82fe-6689078ec4c3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:10.072913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 700/1374] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:10.078290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ecfc-b0a7-4187-83df-e4e245af686a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:10.078742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ecfc-b0a7-4187-83df-e4e245af686a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:10.078838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753ecfc-b0a7-4187-83df-e4e245af686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:10.147654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7753ecfc-b0a7-4187-83df-e4e245af686a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:10.148909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7753ecfc-b0a7-4187-83df-e4e245af686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:10.169793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:10.248319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 675/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:10.540203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8e10c-9849-4414-82fe-6689078ec4c3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:10.541781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7aa8e10c-9849-4414-82fe-6689078ec4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:10.701416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8e10c-9849-4414-82fe-6689078ec4c3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:10.753954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:10.822998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:10.823612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:10.823891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:10.824187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:10.825841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:10.924690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:10.926175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299aab1-db6c-423a-b734-6fe3e32508e2 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:10.944910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 701/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:13.179098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33200e-1247-4966-9785-92f3f046ebe2 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:13.179659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33200e-1247-4966-9785-92f3f046ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:13.179659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33200e-1247-4966-9785-92f3f046ebe2 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:13.181167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 676/1377] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:13.186355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b061c7d-a368-4c98-9ba4-6986981af929 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:13.186739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b061c7d-a368-4c98-9ba4-6986981af929 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:13.186919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b061c7d-a368-4c98-9ba4-6986981af929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:13.257105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1b061c7d-a368-4c98-9ba4-6986981af929 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:13.258312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b061c7d-a368-4c98-9ba4-6986981af929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:13.265570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:13.365294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 702/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:13.659000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33200e-1247-4966-9785-92f3f046ebe2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:13.660594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1e33200e-1247-4966-9785-92f3f046ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:13.815042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33200e-1247-4966-9785-92f3f046ebe2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:13.819356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:13.942451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:13.942962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:13.943241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:13.943520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:13.945176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:14.054604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:14.056413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeccd76-0a4e-46fd-95c5-f1ba05a08f22 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:14.076589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 677/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:16.293743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b01b7-fe4e-42fe-8e38-31f20361488c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:16.294220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b01b7-fe4e-42fe-8e38-31f20361488c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:16.294310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b01b7-fe4e-42fe-8e38-31f20361488c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:16.295757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 703/1380] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:16.300814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0622c7-4fa7-4415-8561-aa392f7bf48b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:16.301204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0622c7-4fa7-4415-8561-aa392f7bf48b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:16.301379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0622c7-4fa7-4415-8561-aa392f7bf48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:16.313883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:16.373605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1f0622c7-4fa7-4415-8561-aa392f7bf48b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:16.374863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1f0622c7-4fa7-4415-8561-aa392f7bf48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:16.527962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 678/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:16.813741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b01b7-fe4e-42fe-8e38-31f20361488c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:16.815254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0f3b01b7-fe4e-42fe-8e38-31f20361488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:16.954923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:16.966923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b01b7-fe4e-42fe-8e38-31f20361488c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:17.079708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:17.080273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:17.080550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:17.080816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:17.082395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:17.174844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:17.176624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2401ab2-3462-4208-9065-83cf20e40c3c service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:17.187280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:17.196739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 704/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:19.358026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed562865-58bf-4c7a-91dd-d1384b63da9f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:19.358672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed562865-58bf-4c7a-91dd-d1384b63da9f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:19.358672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed562865-58bf-4c7a-91dd-d1384b63da9f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:19.359977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 679/1383] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:19.365301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ae62-f181-4f0c-b3b8-708058119280 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:19.365707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ae62-f181-4f0c-b3b8-708058119280 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:19.365856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ae62-f181-4f0c-b3b8-708058119280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:19.431396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c5c8ae62-f181-4f0c-b3b8-708058119280 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:19.432631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c5c8ae62-f181-4f0c-b3b8-708058119280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:19.530639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 705/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:19.817964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed562865-58bf-4c7a-91dd-d1384b63da9f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:19.819474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ed562865-58bf-4c7a-91dd-d1384b63da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:19.908939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:19.972762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed562865-58bf-4c7a-91dd-d1384b63da9f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:20.089768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:20.090296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:20.090576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:20.090846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:20.092472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:20.144111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:20.187048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:20.188974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e679ec9-f7cd-4085-bde8-509540bfaded service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:20.209311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 680/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:22.395365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6df1-4542-4235-b645-504daf37cda3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:22.396392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6df1-4542-4235-b645-504daf37cda3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:22.396392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6df1-4542-4235-b645-504daf37cda3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:22.398115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 706/1386] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:22.403476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eae82-9c66-4cab-9c6e-a80fa8b6a063 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:22.404088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eae82-9c66-4cab-9c6e-a80fa8b6a063 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:22.404088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eae82-9c66-4cab-9c6e-a80fa8b6a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:22.468352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fb4eae82-9c66-4cab-9c6e-a80fa8b6a063 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:22.469384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fb4eae82-9c66-4cab-9c6e-a80fa8b6a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:22.571318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 681/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:22.859420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d6df1-4542-4235-b645-504daf37cda3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:22.861014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b3d6df1-4542-4235-b645-504daf37cda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:22.949013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:23.030834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d6df1-4542-4235-b645-504daf37cda3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:23.170505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:23.171120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:23.171395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:23.171660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:23.173280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:23.218631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:23.285428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:23.287617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cacea2-6d13-4f70-ae7d-37898d1342bf service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:23.312191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 707/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:25.884791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e62ba-419b-4581-83a5-65c8b5f787fa None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:25.885386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e62ba-419b-4581-83a5-65c8b5f787fa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:25.885386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e62ba-419b-4581-83a5-65c8b5f787fa None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:25.886703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 682/1389] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:22:25.892082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8063e-6145-4334-b9a6-918e04f4395d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:25.892555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8063e-6145-4334-b9a6-918e04f4395d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:25.892660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8063e-6145-4334-b9a6-918e04f4395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:25.958130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-73c8063e-6145-4334-b9a6-918e04f4395d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:25.959327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-73c8063e-6145-4334-b9a6-918e04f4395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:26.058082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 708/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:26.349790 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e62ba-419b-4581-83a5-65c8b5f787fa None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:26.351830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1e3e62ba-419b-4581-83a5-65c8b5f787fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:26.383664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:26.499255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e62ba-419b-4581-83a5-65c8b5f787fa None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:26.602852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:26.615074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:26.615678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:26.615973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:26.616247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:26.617808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:26.709261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:26.711372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2bbf8-bbf2-4184-9563-58a05cf27f56 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:26.729807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 683/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:27.110860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d053aa6-f4df-4a81-9d11-ae6aaabdb33e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:27.111382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d053aa6-f4df-4a81-9d11-ae6aaabdb33e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:27.111382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d053aa6-f4df-4a81-9d11-ae6aaabdb33e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:27.112716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 709/1392] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:27.118122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ad91d-a29a-4d5b-a74b-995631f7c60d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:27.118529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ad91d-a29a-4d5b-a74b-995631f7c60d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:27.118789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ad91d-a29a-4d5b-a74b-995631f7c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:27.183537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-234ad91d-a29a-4d5b-a74b-995631f7c60d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:27.184770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-234ad91d-a29a-4d5b-a74b-995631f7c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:27.246323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:27.285575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 684/1393] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:27.586244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4dd3-60f6-43f4-a8bd-f43eb2c0513e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:27.586528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4dd3-60f6-43f4-a8bd-f43eb2c0513e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:27.586826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f4dd3-60f6-43f4-a8bd-f43eb2c0513e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:27.588223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 710/1394] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 22 12:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:27.593742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd3fc-1898-452c-9a43-fed36e346c02 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:27.594029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd3fc-1898-452c-9a43-fed36e346c02 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:27.594483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd3fc-1898-452c-9a43-fed36e346c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:27.673160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-acccd3fc-1898-452c-9a43-fed36e346c02 None None] MFA Rules not processed for user `11272670de874c5094fdfb776b4a8b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:27.674279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-acccd3fc-1898-452c-9a43-fed36e346c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:27.749675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 685/1395] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 22 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:27.758962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4dd3-60f6-43f4-a8bd-f43eb2c0513e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:27.760532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-905f4dd3-60f6-43f4-a8bd-f43eb2c0513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:27.774006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:27.870216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f4dd3-60f6-43f4-a8bd-f43eb2c0513e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:27.945419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:27.945957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:27.946242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:27.946520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:27.948173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:28.016865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:28.059071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:28.060557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d6404-5b7b-40a6-9352-6ce8206e58cf service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:28.078254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 711/1396] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:28.848192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e924-d75a-4cea-bd76-865fb82d8cba None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:28.848722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e924-d75a-4cea-bd76-865fb82d8cba None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:28.848876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e924-d75a-4cea-bd76-865fb82d8cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:28.921233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-eff5e924-d75a-4cea-bd76-865fb82d8cba None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:28.922497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eff5e924-d75a-4cea-bd76-865fb82d8cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:28.932005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:28.934031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3d0ec-99c7-4455-9b7d-96b52a3ea9b1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:28.934518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3d0ec-99c7-4455-9b7d-96b52a3ea9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:28.934748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3d0ec-99c7-4455-9b7d-96b52a3ea9b1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:28.941096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 712/1397] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:22:28.942524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:28.942979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:28.943257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:29.010457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:29.011783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:29.012933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 686/1398] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:29.058961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7808cf6-c486-46bb-af70-9a6a8e41b819 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:29.059344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7808cf6-c486-46bb-af70-9a6a8e41b819 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:29.059625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7808cf6-c486-46bb-af70-9a6a8e41b819 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:29.061028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 687/1399] 10.222.0.25 () {54 vars in 943 bytes} [Thu Sep 22 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:22:29.067190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:29.067549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:29.067820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:29.126847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 713/1400] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:29.150395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] MFA Rules not processed for user `c1605f3029484ea2a5e98a1b10caf075`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:29.151690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:29.246401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:29.270534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 688/1401] 10.222.0.25 () {58 vars in 1040 bytes} [Thu Sep 22 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:22:29.279949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:29.281255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:29.311441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:29.394593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40155b-2350-436b-8ec9-f59ad41ca387 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:29.418125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:29.419438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:29.509717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:29.510325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:29.510603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:29.510865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:29.512721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:29.525998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7036d8-6718-4a02-bd16-69eea9af5505 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:29.556718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:29.600360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:29.601955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182a0d-0f85-4278-82e0-2faa38de67ad service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:29.610181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 714/1402] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:22:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:22:29.635775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:29.643971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:29.645125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:29.645484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:29.645810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:29.648158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:29.749917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:29.751525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f79557-a24e-411e-8a19-7b699ac79f99 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:29.773783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 689/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:31.991605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb90c-9b75-400b-a4b1-d46517bfd2ca None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:31.992176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb90c-9b75-400b-a4b1-d46517bfd2ca None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:31.992176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb90c-9b75-400b-a4b1-d46517bfd2ca None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:31.993597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 715/1404] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:31.998815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538486-69bb-4d9d-8cf8-538467e858e1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:31.999225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538486-69bb-4d9d-8cf8-538467e858e1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:31.999414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1538486-69bb-4d9d-8cf8-538467e858e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:32.071549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a1538486-69bb-4d9d-8cf8-538467e858e1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:32.072819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a1538486-69bb-4d9d-8cf8-538467e858e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:32.140442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:32.176534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 690/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:32.464367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fb90c-9b75-400b-a4b1-d46517bfd2ca None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:32.466035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3e7fb90c-9b75-400b-a4b1-d46517bfd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:32.654322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fb90c-9b75-400b-a4b1-d46517bfd2ca None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:32.697882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:32.782660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:32.783194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:32.783471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:32.783739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:32.785355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:32.895567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:32.897292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc7a9-448b-4b1f-9e63-d023791c162c service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:32.917681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 716/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:35.120839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b27a5f-f339-4d5e-9695-6fc467b78c3a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:35.121746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b27a5f-f339-4d5e-9695-6fc467b78c3a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:35.122181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b27a5f-f339-4d5e-9695-6fc467b78c3a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:35.123994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 691/1407] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:35.129217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bcc73-41b3-4453-8564-aa09906cd67c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:35.129650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bcc73-41b3-4453-8564-aa09906cd67c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:35.129809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bcc73-41b3-4453-8564-aa09906cd67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:35.182586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:35.205634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-201bcc73-41b3-4453-8564-aa09906cd67c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:35.206845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-201bcc73-41b3-4453-8564-aa09906cd67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:35.315566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 717/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:35.606381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b27a5f-f339-4d5e-9695-6fc467b78c3a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:35.608138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-48b27a5f-f339-4d5e-9695-6fc467b78c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:35.769637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b27a5f-f339-4d5e-9695-6fc467b78c3a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:35.827225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:35.902560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:35.903440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:35.903856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:35.904268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:35.906403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:36.016594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:36.018793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf93831-d255-487c-b79a-fa78c51c0fb0 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:36.040428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 692/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:45.314072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=47 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:46.037909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=75 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:51.973481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944795-0636-4615-950f-bd3e3fbb07b1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:51.974060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944795-0636-4615-950f-bd3e3fbb07b1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:51.974060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944795-0636-4615-950f-bd3e3fbb07b1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:51.975433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 718/1410] 10.222.0.25 () {54 vars in 918 bytes} [Thu Sep 22 12:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:51.980576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559165-1539-4278-912f-015abd427c29 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:51.981014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559165-1539-4278-912f-015abd427c29 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:51.981153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad559165-1539-4278-912f-015abd427c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:52.055495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ad559165-1539-4278-912f-015abd427c29 None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:52.056745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ad559165-1539-4278-912f-015abd427c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:52.160318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 693/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 22 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:52.174869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004c3e-2c75-43a8-8e46-2464f66df9f5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:52.175150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004c3e-2c75-43a8-8e46-2464f66df9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:52.175710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004c3e-2c75-43a8-8e46-2464f66df9f5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:52.177075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 719/1412] 10.222.0.25 () {54 vars in 918 bytes} [Thu Sep 22 12:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:52.181810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd02e0-82f4-4403-9edb-8557bf8cf67b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:52.182099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd02e0-82f4-4403-9edb-8557bf8cf67b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:52.182372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd02e0-82f4-4403-9edb-8557bf8cf67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:52.270045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:52.273244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5edd02e0-82f4-4403-9edb-8557bf8cf67b None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:52.275099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5edd02e0-82f4-4403-9edb-8557bf8cf67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:52.388885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 694/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 22 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:54.971944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ed9d-1d9c-4ef3-9a80-f89cf4e68368 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:54.972536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ed9d-1d9c-4ef3-9a80-f89cf4e68368 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:54.972536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ed9d-1d9c-4ef3-9a80-f89cf4e68368 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:54.973914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:54.979296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1ed3-6e25-443c-bad4-dbe6477e7bdf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:54.979701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1ed3-6e25-443c-bad4-dbe6477e7bdf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:54.979846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e1ed3-6e25-443c-bad4-dbe6477e7bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:55.049296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ad2e1ed3-6e25-443c-bad4-dbe6477e7bdf None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:55.050864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ad2e1ed3-6e25-443c-bad4-dbe6477e7bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:55.104786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:55.148007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:55.433012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ed9d-1d9c-4ef3-9a80-f89cf4e68368 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:55.434718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6358ed9d-1d9c-4ef3-9a80-f89cf4e68368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:55.577413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ed9d-1d9c-4ef3-9a80-f89cf4e68368 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:55.650532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:55.702275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:55.703078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:55.703494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:55.703897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:55.706427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:55.803877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:55.805476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a90ea-6784-4d88-b766-d198799904e3 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:55.822648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 721/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:56.963421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a69ed-b421-4497-b268-9daf19e60089 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:56.964039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a69ed-b421-4497-b268-9daf19e60089 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:56.964039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a69ed-b421-4497-b268-9daf19e60089 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:56.965849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:56.971915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee8f6-0d0e-4808-b6ae-caae80a121a3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:56.972371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee8f6-0d0e-4808-b6ae-caae80a121a3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:56.972480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee8f6-0d0e-4808-b6ae-caae80a121a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:57.049411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5feee8f6-0d0e-4808-b6ae-caae80a121a3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:57.050625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5feee8f6-0d0e-4808-b6ae-caae80a121a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:57.077191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:57.145454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:57.294904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a69ed-b421-4497-b268-9daf19e60089 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:57.296376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b84a69ed-b421-4497-b268-9daf19e60089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:57.440946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a69ed-b421-4497-b268-9daf19e60089 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:57.480859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:57.552970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:57.553486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:57.553766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:57.554039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:57.555616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:57.644145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:57.645763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1149aca-41f4-4ed3-bc40-3c7b12e3bc9a service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:57.663655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 697/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:58.797135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5f36-9924-43e1-9c1f-f26bc472b499 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:58.797730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5f36-9924-43e1-9c1f-f26bc472b499 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:58.797954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a5f36-9924-43e1-9c1f-f26bc472b499 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:58.800086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:22:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:22:58.806581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717f1d9-b44f-47dc-ae59-4b87688a18a8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:58.807006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717f1d9-b44f-47dc-ae59-4b87688a18a8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:58.807124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717f1d9-b44f-47dc-ae59-4b87688a18a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:58.861779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:58.884389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9717f1d9-b44f-47dc-ae59-4b87688a18a8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:22:58.886077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9717f1d9-b44f-47dc-ae59-4b87688a18a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:58.979658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:22:59.149436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a5f36-9924-43e1-9c1f-f26bc472b499 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:22:59.151028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-241a5f36-9924-43e1-9c1f-f26bc472b499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:59.297391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a5f36-9924-43e1-9c1f-f26bc472b499 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:22:59.309486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:59.409743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:22:59.410260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:22:59.410534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:22:59.410800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:22:59.412450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:22:59.501373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:22:59.502947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2583609-d15b-4800-a44f-05f142a7f656 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:22:59.521061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 724/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:00.640277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b44c-e538-466b-a2f9-2cdd61ae0559 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:00.640807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b44c-e538-466b-a2f9-2cdd61ae0559 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:00.640807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b44c-e538-466b-a2f9-2cdd61ae0559 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:00.642164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:00.648252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2b333-d457-49a5-a892-beee7e763341 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:00.648657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2b333-d457-49a5-a892-beee7e763341 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:00.648808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2b333-d457-49a5-a892-beee7e763341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:00.669384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:00.729069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e0d2b333-d457-49a5-a892-beee7e763341 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:00.731501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e0d2b333-d457-49a5-a892-beee7e763341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:00.828870 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:00.978748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b44c-e538-466b-a2f9-2cdd61ae0559 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:00.980312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ed70b44c-e538-466b-a2f9-2cdd61ae0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:01.091162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:01.125893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b44c-e538-466b-a2f9-2cdd61ae0559 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:01.236623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:01.237232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:01.237508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:01.237776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:01.239332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:01.313048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:01.329201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:01.330798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61b824-14b7-481b-a47d-db480a2ac10c service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:01.348493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 700/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:02.459997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ca1-4160-4367-bb16-f44bf0db5f94 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:02.460508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ca1-4160-4367-bb16-f44bf0db5f94 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:02.460508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153ca1-4160-4367-bb16-f44bf0db5f94 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:02.461831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:02.468553 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606954-a03c-4a78-9660-0b679b29121e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:02.469003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606954-a03c-4a78-9660-0b679b29121e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:02.469640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606954-a03c-4a78-9660-0b679b29121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:02.547887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1d606954-a03c-4a78-9660-0b679b29121e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:02.549115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1d606954-a03c-4a78-9660-0b679b29121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:02.643948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:02.792798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ca1-4160-4367-bb16-f44bf0db5f94 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:02.794277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ed153ca1-4160-4367-bb16-f44bf0db5f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:02.877229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:02.940122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153ca1-4160-4367-bb16-f44bf0db5f94 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:03.051718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:03.052276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:03.052554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:03.052824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:03.054409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:03.103644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:03.144770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:03.146344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1131056-cdb7-46ce-bc77-eb03c7795ad1 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:03.163645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 727/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:04.226164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4249801-ebbf-4d08-9c1f-5cf845fca902 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:04.226670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4249801-ebbf-4d08-9c1f-5cf845fca902 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:04.226779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4249801-ebbf-4d08-9c1f-5cf845fca902 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:04.228079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:04.234417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8b9f-6d38-4fa2-bd32-ad72a28ee68e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:04.234872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8b9f-6d38-4fa2-bd32-ad72a28ee68e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:04.234980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8b9f-6d38-4fa2-bd32-ad72a28ee68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:04.309362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-badb8b9f-6d38-4fa2-bd32-ad72a28ee68e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:04.310586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-badb8b9f-6d38-4fa2-bd32-ad72a28ee68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:04.406818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:04.554392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4249801-ebbf-4d08-9c1f-5cf845fca902 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:04.555867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c4249801-ebbf-4d08-9c1f-5cf845fca902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:04.605429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:04.701948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4249801-ebbf-4d08-9c1f-5cf845fca902 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:04.814366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:04.815227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:04.815510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:04.815785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:04.817527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:04.825889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:04.909453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:04.911080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ca67d-5731-4c88-b898-0f710c41c211 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:04.929308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 703/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:05.975312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b8d7-e5f9-40ac-a6de-dbc965cb9b2c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:05.975857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b8d7-e5f9-40ac-a6de-dbc965cb9b2c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:05.975857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b8d7-e5f9-40ac-a6de-dbc965cb9b2c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:05.977247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:05.983309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5d000-778b-4431-a437-7387b9edb86c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:05.983701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5d000-778b-4431-a437-7387b9edb86c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:05.983865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5d000-778b-4431-a437-7387b9edb86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:06.058802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-58b5d000-778b-4431-a437-7387b9edb86c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:06.060028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-58b5d000-778b-4431-a437-7387b9edb86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:06.125537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:06.154379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:06.302642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b8d7-e5f9-40ac-a6de-dbc965cb9b2c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:06.304148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbe7b8d7-e5f9-40ac-a6de-dbc965cb9b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:06.322244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:06.448375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b8d7-e5f9-40ac-a6de-dbc965cb9b2c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:06.533684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:06.560389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:06.561098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:06.561269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:06.561631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:06.563116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:06.652379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:06.653961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf76a7-75a2-4c35-be30-e89cd4f9d417 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:06.671856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 730/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:07.717646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf362b-f5b9-499e-bf1e-99d709b86350 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:07.718191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf362b-f5b9-499e-bf1e-99d709b86350 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:07.718191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf362b-f5b9-499e-bf1e-99d709b86350 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:07.719519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:07.725788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab8212-c447-4c0e-89c9-3800b82c7c2c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:07.726232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab8212-c447-4c0e-89c9-3800b82c7c2c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:07.726329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab8212-c447-4c0e-89c9-3800b82c7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:07.815503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-53ab8212-c447-4c0e-89c9-3800b82c7c2c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:07.816736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-53ab8212-c447-4c0e-89c9-3800b82c7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:07.856835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:07.912777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:08.062840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf362b-f5b9-499e-bf1e-99d709b86350 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:08.064347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7ccf362b-f5b9-499e-bf1e-99d709b86350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:08.212527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf362b-f5b9-499e-bf1e-99d709b86350 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:08.265303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:08.322291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:08.322821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:08.323100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:08.323376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:08.325004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:08.414032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:08.416283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90932a-63b7-43fb-a80c-05099dfd24ac service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:08.433808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 706/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:09.507151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1398d1-57aa-43be-8203-02cee59191a5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:09.507693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1398d1-57aa-43be-8203-02cee59191a5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:09.507693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1398d1-57aa-43be-8203-02cee59191a5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:09.509232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:09.515549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1fda3-096c-4617-9576-f7e30c256587 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:09.516006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1fda3-096c-4617-9576-f7e30c256587 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:09.516132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1fda3-096c-4617-9576-f7e30c256587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:09.590397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-37d1fda3-096c-4617-9576-f7e30c256587 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:09.591584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-37d1fda3-096c-4617-9576-f7e30c256587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:09.593584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:09.685915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:09.837343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1398d1-57aa-43be-8203-02cee59191a5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:09.838757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ee1398d1-57aa-43be-8203-02cee59191a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:09.981586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1398d1-57aa-43be-8203-02cee59191a5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:10.007442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:10.099624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:10.100185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:10.100473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:10.100741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:10.102820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:10.199969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:10.199969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a5ff-9fb0-4a75-844e-a6967f658933 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:10.217428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 733/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:12.278018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975234c2-16ee-4613-9ff6-4d63c1e6d959 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:12.278584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975234c2-16ee-4613-9ff6-4d63c1e6d959 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:12.278584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975234c2-16ee-4613-9ff6-4d63c1e6d959 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:12.279954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:12.285408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510e96-0a7f-43c4-ad27-f05efdc2f109 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:12.285851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510e96-0a7f-43c4-ad27-f05efdc2f109 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:12.285960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510e96-0a7f-43c4-ad27-f05efdc2f109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:12.327194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:12.352374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e0510e96-0a7f-43c4-ad27-f05efdc2f109 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:12.353550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e0510e96-0a7f-43c4-ad27-f05efdc2f109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:12.446997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:12.734374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975234c2-16ee-4613-9ff6-4d63c1e6d959 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:12.735908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-975234c2-16ee-4613-9ff6-4d63c1e6d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:12.836526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975234c2-16ee-4613-9ff6-4d63c1e6d959 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:12.867828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:12.909485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:12.910088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:12.910368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:12.910640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:12.912270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:13.019023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:13.020496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c31f6d-3d64-4a5a-8baa-78d1b0eac128 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:13.038406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 709/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:15.333154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0015bf-f918-4c3a-9fe0-7d640170b2cf None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:15.333741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0015bf-f918-4c3a-9fe0-7d640170b2cf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:15.333741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0015bf-f918-4c3a-9fe0-7d640170b2cf None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:15.335072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:15.340343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3868-dcea-4a94-b2ff-7df5722c866a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:15.340743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3868-dcea-4a94-b2ff-7df5722c866a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:15.340895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3868-dcea-4a94-b2ff-7df5722c866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:15.405406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f98f3868-dcea-4a94-b2ff-7df5722c866a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:15.406595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f98f3868-dcea-4a94-b2ff-7df5722c866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:15.419776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:15.502128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:15.784465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0015bf-f918-4c3a-9fe0-7d640170b2cf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:15.786003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9e0015bf-f918-4c3a-9fe0-7d640170b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:15.892810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0015bf-f918-4c3a-9fe0-7d640170b2cf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:15.905950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:15.967425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:15.968057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:15.968332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:15.968597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:15.970176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:16.076488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:16.077836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb1e6-9ff3-445e-bb0a-b49ff9a67b26 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:16.095649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 736/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:18.530967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92c6a-6bea-40c6-a063-bbb22b4d1d44 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:18.531538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92c6a-6bea-40c6-a063-bbb22b4d1d44 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:18.531538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92c6a-6bea-40c6-a063-bbb22b4d1d44 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:18.532791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:18.538985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b651535-e453-42dd-ba46-527deb5a7011 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:18.539423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b651535-e453-42dd-ba46-527deb5a7011 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:18.539637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b651535-e453-42dd-ba46-527deb5a7011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:18.587758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:18.606126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5b651535-e453-42dd-ba46-527deb5a7011 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:18.607344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5b651535-e453-42dd-ba46-527deb5a7011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:18.700958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:18.983443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b92c6a-6bea-40c6-a063-bbb22b4d1d44 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:18.985019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e6b92c6a-6bea-40c6-a063-bbb22b4d1d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:19.086445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b92c6a-6bea-40c6-a063-bbb22b4d1d44 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:19.128937 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:19.163199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:19.163795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:19.164109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:19.164384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:19.165961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:19.273180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:19.274593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e907e12-524a-40c6-9458-bb7a598bacef service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:19.407892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 712/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:21.663283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b3aa-ef38-47b1-9aa1-f5b603521c69 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:21.663889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b3aa-ef38-47b1-9aa1-f5b603521c69 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:21.663889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b3aa-ef38-47b1-9aa1-f5b603521c69 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:21.665227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:21.670540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da33ea-ad7d-41b2-a10c-470a4282b756 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:21.670968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da33ea-ad7d-41b2-a10c-470a4282b756 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:21.671073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da33ea-ad7d-41b2-a10c-470a4282b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:21.735417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c4da33ea-ad7d-41b2-a10c-470a4282b756 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:21.736660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c4da33ea-ad7d-41b2-a10c-470a4282b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:21.756790 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:21.830187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:22.117307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b3aa-ef38-47b1-9aa1-f5b603521c69 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:22.118844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48f2b3aa-ef38-47b1-9aa1-f5b603521c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:22.221867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b3aa-ef38-47b1-9aa1-f5b603521c69 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:22.242142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:22.294812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:22.295408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:22.295681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:22.295965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:22.297544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:22.403573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:22.405025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787bc5-754c-4612-9137-b6e388bfed1e service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:22.422319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 739/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:24.664450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926654-4e36-4de7-9ee4-501dbacbd3f0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:24.664988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926654-4e36-4de7-9ee4-501dbacbd3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:24.664988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926654-4e36-4de7-9ee4-501dbacbd3f0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:24.666344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:24.671832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af024-6954-4fbc-956e-245eafdd88f0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:24.672255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af024-6954-4fbc-956e-245eafdd88f0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:24.672417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af024-6954-4fbc-956e-245eafdd88f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:24.735006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:24.737824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d28af024-6954-4fbc-956e-245eafdd88f0 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:24.739631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d28af024-6954-4fbc-956e-245eafdd88f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:24.836442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:25.121493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926654-4e36-4de7-9ee4-501dbacbd3f0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:25.123025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c2926654-4e36-4de7-9ee4-501dbacbd3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:25.227960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2926654-4e36-4de7-9ee4-501dbacbd3f0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:25.276310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:25.299719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:25.300353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:25.300630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:25.300901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:25.302983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:25.409517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:25.410952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b7c34-3936-4fc7-88ad-bb163e0940b0 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:25.428937 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 715/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:27.624911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ddae-0c85-41b2-ae3b-2c4ad70beab7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:27.625467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ddae-0c85-41b2-ae3b-2c4ad70beab7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:27.625467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ddae-0c85-41b2-ae3b-2c4ad70beab7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:27.626823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:27.632316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ed29-5175-4b4a-91ac-7f9fbf47c34a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:27.632741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ed29-5175-4b4a-91ac-7f9fbf47c34a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:27.632857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ed29-5175-4b4a-91ac-7f9fbf47c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:27.697007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b500ed29-5175-4b4a-91ac-7f9fbf47c34a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:27.698210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b500ed29-5175-4b4a-91ac-7f9fbf47c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:27.727268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:27.793432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:28.080126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ddae-0c85-41b2-ae3b-2c4ad70beab7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:28.082300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fba2ddae-0c85-41b2-ae3b-2c4ad70beab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:28.182312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ddae-0c85-41b2-ae3b-2c4ad70beab7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:28.212445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:28.260082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:28.260688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:28.260966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:28.261234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:28.262820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:28.370563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:28.372025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165629b-0dbf-47d1-83db-b0db601a1a7b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:28.390818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 742/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:30.633936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2176d6-faf7-4664-bb72-21c96b41815a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:30.634415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2176d6-faf7-4664-bb72-21c96b41815a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:30.634524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2176d6-faf7-4664-bb72-21c96b41815a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:30.635819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:30.641054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8555b-d41a-43e7-b9d0-2a148677bf12 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:30.641454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8555b-d41a-43e7-b9d0-2a148677bf12 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:30.641591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8555b-d41a-43e7-b9d0-2a148677bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:30.706589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f1f8555b-d41a-43e7-b9d0-2a148677bf12 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:30.707751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f1f8555b-d41a-43e7-b9d0-2a148677bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:30.715875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:30.804683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:31.087695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2176d6-faf7-4664-bb72-21c96b41815a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:31.089256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0a2176d6-faf7-4664-bb72-21c96b41815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:31.194580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2176d6-faf7-4664-bb72-21c96b41815a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:31.250852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:31.270187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:31.270721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:31.270995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:31.271260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:31.272857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:31.378645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:31.380089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec373f-5081-4f82-a9e6-d8595fe9b8bb service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:31.397279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 718/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:33.592837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fedc-e394-4f43-9987-0372ff2b5941 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:33.593368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fedc-e394-4f43-9987-0372ff2b5941 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:33.593368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5fedc-e394-4f43-9987-0372ff2b5941 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:33.594691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:33.600749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4d48-4913-470d-9f9e-7c661273f0c9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:33.601155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4d48-4913-470d-9f9e-7c661273f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:33.601306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4d48-4913-470d-9f9e-7c661273f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:33.666304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6c9a4d48-4913-470d-9f9e-7c661273f0c9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:33.667498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6c9a4d48-4913-470d-9f9e-7c661273f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:33.704257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:33.761300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:34.055507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fedc-e394-4f43-9987-0372ff2b5941 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:34.057074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-81a5fedc-e394-4f43-9987-0372ff2b5941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:34.159240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5fedc-e394-4f43-9987-0372ff2b5941 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:34.196198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:34.233078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:34.233677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:34.233947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:34.234212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:34.235777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:34.341948 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:34.343282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3211-f2bf-48d6-8738-96ac6547fdad service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:34.476630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 745/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:36.655538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044c39-9ed7-418c-a3b7-8ef87d509c34 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:36.656095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044c39-9ed7-418c-a3b7-8ef87d509c34 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:36.656201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39044c39-9ed7-418c-a3b7-8ef87d509c34 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:36.657508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:36.663273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e842b-2e97-4908-b44c-1cedd03602ea None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:36.663692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e842b-2e97-4908-b44c-1cedd03602ea None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:36.663824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e842b-2e97-4908-b44c-1cedd03602ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:36.727483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e43e842b-2e97-4908-b44c-1cedd03602ea None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:36.728703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e43e842b-2e97-4908-b44c-1cedd03602ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:36.746153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:36.822545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:37.104802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39044c39-9ed7-418c-a3b7-8ef87d509c34 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:37.106382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-39044c39-9ed7-418c-a3b7-8ef87d509c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:37.212847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39044c39-9ed7-418c-a3b7-8ef87d509c34 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:37.278315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:37.285476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:37.286088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:37.286369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:37.286645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:37.288261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:37.393316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:37.394750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe16735-a974-4df6-b894-51bc3c86bb70 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:37.412340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 721/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:23:39.592482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4566-45af-41fd-afc8-518ed8958020 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:39.593017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4566-45af-41fd-afc8-518ed8958020 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:39.593017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4566-45af-41fd-afc8-518ed8958020 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:39.594261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:23:39.600207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90c3e4-5655-4291-ac04-20cfe1b6604a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:39.600650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90c3e4-5655-4291-ac04-20cfe1b6604a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:39.600764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90c3e4-5655-4291-ac04-20cfe1b6604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:39.666520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5e90c3e4-5655-4291-ac04-20cfe1b6604a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:23:39.667709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5e90c3e4-5655-4291-ac04-20cfe1b6604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:39.714093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:39.761114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:23:40.040363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4566-45af-41fd-afc8-518ed8958020 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:23:40.041879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-449e4566-45af-41fd-afc8-518ed8958020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:40.145127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4566-45af-41fd-afc8-518ed8958020 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:23:40.193066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:40.220943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:23:40.221548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:23:40.221819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:23:40.222081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:23:40.223641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:23:40.330767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:23:40.332132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f680c-f999-49e8-abc7-59e2d4fcbc4c service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:23:40.349265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 748/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:23:49.759614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=22 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:23:50.347037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=66 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:00.193537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1b66-eeb4-4fe5-bf2f-3d1293965386 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:00.194104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1b66-eeb4-4fe5-bf2f-3d1293965386 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:00.194104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1b66-eeb4-4fe5-bf2f-3d1293965386 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:00.195427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 723/1471] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:00.200832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55232b-50a6-4602-a8af-1f1228ed1128 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:00.201318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55232b-50a6-4602-a8af-1f1228ed1128 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:00.201590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55232b-50a6-4602-a8af-1f1228ed1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:00.268859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5d55232b-50a6-4602-a8af-1f1228ed1128 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:00.270894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5d55232b-50a6-4602-a8af-1f1228ed1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:00.370630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 749/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:00.667442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf66e-8585-4dac-b896-d549fb2ca0a9 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:00.667724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf66e-8585-4dac-b896-d549fb2ca0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:00.668027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf66e-8585-4dac-b896-d549fb2ca0a9 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:00.669350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 724/1473] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 22 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:00.674192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159534-dd99-4c59-8db6-bd0457952167 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:00.674475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159534-dd99-4c59-8db6-bd0457952167 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:00.674748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf159534-dd99-4c59-8db6-bd0457952167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:00.749284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cf159534-dd99-4c59-8db6-bd0457952167 None None] MFA Rules not processed for user `11272670de874c5094fdfb776b4a8b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:00.750472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf159534-dd99-4c59-8db6-bd0457952167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:00.770957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:00.824502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 750/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 22 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:00.832656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaf66e-8585-4dac-b896-d549fb2ca0a9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:00.834145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eddaf66e-8585-4dac-b896-d549fb2ca0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:00.938258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaf66e-8585-4dac-b896-d549fb2ca0a9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:01.011951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:01.012563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:01.012852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:01.013124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:01.015270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:01.069287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:01.124235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:01.125691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecba1f2-8cb5-4c1d-9c4f-6658bf7bdcfb service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:01.144141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 725/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:24:03.391217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48c693-9094-4959-9293-a3ae74f0a8c1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:03.391779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48c693-9094-4959-9293-a3ae74f0a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:03.391779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48c693-9094-4959-9293-a3ae74f0a8c1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:03.393173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 751/1476] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:03.398625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deda1a-dc4f-43d8-a982-9c2a830488ab None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:03.399006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deda1a-dc4f-43d8-a982-9c2a830488ab None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:03.399168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deda1a-dc4f-43d8-a982-9c2a830488ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:03.464950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-36deda1a-dc4f-43d8-a982-9c2a830488ab None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:03.466101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-36deda1a-dc4f-43d8-a982-9c2a830488ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:03.561512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 726/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:03.839366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48c693-9094-4959-9293-a3ae74f0a8c1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:03.840853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1c48c693-9094-4959-9293-a3ae74f0a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:03.964421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48c693-9094-4959-9293-a3ae74f0a8c1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:04.014139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:04.057846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:04.058447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:04.058721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:04.058989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:04.059616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:04.061360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:24:04.061360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:24:04.061360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:24:04.062482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89204fa-e96a-4903-944c-eef9f72603ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:04.080965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 752/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 22 12:24:03 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:24:06.241082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65f40-e5fa-4f79-a054-13bca1882c85 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:06.241547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65f40-e5fa-4f79-a054-13bca1882c85 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:06.241657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c65f40-e5fa-4f79-a054-13bca1882c85 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:06.243030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 727/1479] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:06.248935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea1fe-563e-447f-afd8-9608583d9cf1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:06.249383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea1fe-563e-447f-afd8-9608583d9cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:06.249490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea1fe-563e-447f-afd8-9608583d9cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:06.315796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0c9ea1fe-563e-447f-afd8-9608583d9cf1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:06.317047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c9ea1fe-563e-447f-afd8-9608583d9cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:06.412979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 753/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:06.706995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c65f40-e5fa-4f79-a054-13bca1882c85 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:06.708611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d3c65f40-e5fa-4f79-a054-13bca1882c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:06.718344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:06.849999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c65f40-e5fa-4f79-a054-13bca1882c85 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:06.931857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:06.963647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:06.964275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:06.964560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:06.964826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:06.966901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:07.054041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:07.055619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7253d-912a-4a8f-8020-fd55824c1ca9 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:07.073123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 728/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:24:09.379952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ce95-3c8d-401e-9aa9-219465adae34 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:09.380514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ce95-3c8d-401e-9aa9-219465adae34 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:09.380514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ce95-3c8d-401e-9aa9-219465adae34 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:09.381889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 754/1482] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:09.387880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687687-f9f0-4187-86a5-a1751228af0f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:09.388361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687687-f9f0-4187-86a5-a1751228af0f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:09.388465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08687687-f9f0-4187-86a5-a1751228af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:09.453745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-08687687-f9f0-4187-86a5-a1751228af0f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:09.454852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-08687687-f9f0-4187-86a5-a1751228af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:09.499254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:09.549002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 729/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:24:09.833043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ce95-3c8d-401e-9aa9-219465adae34 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:09.834565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f87ce95-3c8d-401e-9aa9-219465adae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:09.858100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:09.939332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ce95-3c8d-401e-9aa9-219465adae34 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:10.010658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:10.011252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:10.011533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:10.011820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:10.013413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:10.086663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:10.123288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:10.124752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51659645-1c54-412b-bb9a-f7998419438f service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:10.142289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 755/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:24:12.350481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf736fc-2e44-4d42-a1b0-1598e586f128 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:12.351046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf736fc-2e44-4d42-a1b0-1598e586f128 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:12.351046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf736fc-2e44-4d42-a1b0-1598e586f128 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:12.352411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 730/1485] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:12.357783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48a2a7-88d5-46a2-8bc1-52512315fb1c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:12.358214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48a2a7-88d5-46a2-8bc1-52512315fb1c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:12.358329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48a2a7-88d5-46a2-8bc1-52512315fb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:12.423291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ba48a2a7-88d5-46a2-8bc1-52512315fb1c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:12.424528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ba48a2a7-88d5-46a2-8bc1-52512315fb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:12.519374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 756/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:12.805447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf736fc-2e44-4d42-a1b0-1598e586f128 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:12.806984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bcf736fc-2e44-4d42-a1b0-1598e586f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:12.915295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf736fc-2e44-4d42-a1b0-1598e586f128 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:12.986751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:12.988379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:12.989088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:12.989366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:12.989669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:12.991736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:13.097241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:13.098628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f6223-2ee0-4716-8a97-76bb4cd13eaa service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:13.116862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 731/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:24:15.354535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a987e98-a9c1-4ff4-9d94-ff45bebe4313 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:15.355137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a987e98-a9c1-4ff4-9d94-ff45bebe4313 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:15.355137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a987e98-a9c1-4ff4-9d94-ff45bebe4313 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:15.356482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 757/1488] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:15.361729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fc393-6fb9-4c6c-8e27-ea341938c372 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:15.362168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fc393-6fb9-4c6c-8e27-ea341938c372 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:15.362268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fc393-6fb9-4c6c-8e27-ea341938c372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:15.427860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-aa0fc393-6fb9-4c6c-8e27-ea341938c372 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:15.429086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aa0fc393-6fb9-4c6c-8e27-ea341938c372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:15.480799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:15.524754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 732/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:15.818211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a987e98-a9c1-4ff4-9d94-ff45bebe4313 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:15.819770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1a987e98-a9c1-4ff4-9d94-ff45bebe4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:15.856277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:15.922646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a987e98-a9c1-4ff4-9d94-ff45bebe4313 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:15.999477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:16.000110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:16.000389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:16.000658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:16.002238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:16.081227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:16.111150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:16.112651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cb0ed-9564-443c-9ba7-0015a4487553 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:16.130638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 758/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:24:18.461486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd221e-065a-4750-abfc-0ed6f97a6c5f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:18.462026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd221e-065a-4750-abfc-0ed6f97a6c5f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:18.462026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd221e-065a-4750-abfc-0ed6f97a6c5f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:18.463289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 733/1491] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 22 12:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:24:18.469086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795132-b432-4c26-a8a3-1ab5c786ac33 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:18.469530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795132-b432-4c26-a8a3-1ab5c786ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:18.469660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25795132-b432-4c26-a8a3-1ab5c786ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:18.535744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-25795132-b432-4c26-a8a3-1ab5c786ac33 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:24:18.536983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-25795132-b432-4c26-a8a3-1ab5c786ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:18.631406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 759/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 22 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:24:18.921721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd221e-065a-4750-abfc-0ed6f97a6c5f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:24:18.923271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e6dd221e-065a-4750-abfc-0ed6f97a6c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:19.024781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd221e-065a-4750-abfc-0ed6f97a6c5f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:24:19.095687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:24:19.096314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:24:19.096593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:24:19.096863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:24:19.098442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:24:19.106803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:19.205125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:24:19.206566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2296aad-9ba3-42f7-92b1-fb9ad5a2bee6 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:24:19.224232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 734/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:24:28.630009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=82 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:29.222191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=50 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:32.801271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:32.801793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:32.801793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:32.880027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:25:32.881271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:32.979039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 760/1494] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:25:32.987506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:32.988020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:32.988134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:33.062701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:25:33.063829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:33.162481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 735/1495] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:25:33.167156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:33.168397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:33.179587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bfb3-09c6-4784-8401-52905b74cba3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:33.243869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:33.277583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:33.278183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:33.278456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:33.278721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:33.279348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:25:33.279644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:33.280687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:33.280687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:25:33.280687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:25:33.281559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:33.293016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 761/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:25:33.301561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:33.310516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9d41-c726-4f2e-bc70-febfe8a44429 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:33.370524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:33.403939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:33.404554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:33.404833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:33.405105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:33.405731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:33.407457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:33.407457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:25:33.407457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:25:33.409284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:33.467189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 736/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:25:33 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:25:33.472178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:33.473747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:33.506673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db17c6e-385b-4d73-9615-369f4a3d35e2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:33.598817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:33.599414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:33.599687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:33.599975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:33.600606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:33.601601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:33.601601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:25:33.601601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:25:33.602792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:33.645331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 762/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:25:33 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:25:33.649517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:33.651067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:33.711188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba4c37-bc67-4a54-8014-f8e7cdcfeba1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:33.790958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:33.801251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:33.801845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:33.802119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:33.802392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:33.803021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:33.804080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:33.804080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:25:33.804080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:25:33.804969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:33.817392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 737/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:25:33.821345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:33.822848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:33.834722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99469501-70d2-47a2-acf5-cebc09bee32b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:33.858991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:33.931771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:33.932324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:33.932598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:33.932867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:33.933499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:33.934500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:33.934500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:25:33.934500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:25:33.935419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c553a1-138e-4542-99dd-b2094474fe01 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:33.948087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 763/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:25:33.952275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:33.953782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:33.985871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ad607-27be-4f96-9b4e-891a130308c9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:34.078968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:34.079601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:34.079912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:34.080210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] PATH_INFO: `/v3/projects/6441b54b71a446bd91daa85830b74ab6/users/9ef6f96422f9470a93983d3ff2b8c3c6/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:34.101699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6441b54b71a446bd91daa85830b74ab6, user_id=9ef6f96422f9470a93983d3ff2b8c3c6, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:34.102717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:34.102717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:25:34.102717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:25:34.104683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76e90b-4f9c-4a17-8e7a-a8f071a360a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:34.130210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 738/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:25:33 2022] PUT /identity/v3/projects/6441b54b71a446bd91daa85830b74ab6/users/9ef6f96422f9470a93983d3ff2b8c3c6/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:25:34.142205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df44d-8d21-40fe-ba98-ead14cf941b6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:34.142614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df44d-8d21-40fe-ba98-ead14cf941b6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:34.142942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0df44d-8d21-40fe-ba98-ead14cf941b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:34.200363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0f0df44d-8d21-40fe-ba98-ead14cf941b6 None None] MFA Rules not processed for user `9ef6f96422f9470a93983d3ff2b8c3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:25:34.201718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0f0df44d-8d21-40fe-ba98-ead14cf941b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:34.277917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 764/1502] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:25:34.291704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759403f6-db3d-4b06-a8dd-0b4f40e4722f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:34.292029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759403f6-db3d-4b06-a8dd-0b4f40e4722f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:34.292311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759403f6-db3d-4b06-a8dd-0b4f40e4722f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:34.293661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 739/1503] 10.222.0.25 () {54 vars in 963 bytes} [Thu Sep 22 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:25:34.298512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b833-691f-4839-831a-64d24e9af0d5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:34.299397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b833-691f-4839-831a-64d24e9af0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:34.299689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b833-691f-4839-831a-64d24e9af0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:34.330154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:34.376365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2d16b833-691f-4839-831a-64d24e9af0d5 None None] MFA Rules not processed for user `fc7ee82e55b8416dbf41dd368cc435d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:25:34.377571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2d16b833-691f-4839-831a-64d24e9af0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:34.452559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 765/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Thu Sep 22 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:25:34.462040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759403f6-db3d-4b06-a8dd-0b4f40e4722f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:34.463586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-759403f6-db3d-4b06-a8dd-0b4f40e4722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:34.513221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:34.567277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759403f6-db3d-4b06-a8dd-0b4f40e4722f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:34.638617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:34.639218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:34.639477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:34.639744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:34.641333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:34.737531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:34.738888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:34.742594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:34.757293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 740/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:25:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:25:34.802478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa51a-acb4-408c-bafe-e9caf09f0b82 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:34.802758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa51a-acb4-408c-bafe-e9caf09f0b82 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:34.803026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fa51a-acb4-408c-bafe-e9caf09f0b82 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:34.804348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 766/1506] 10.222.0.25 () {52 vars in 830 bytes} [Thu Sep 22 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:25:34.807848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:34.809091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:34.913887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47828-c664-4f27-a75d-fdf9163ca2e8 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:35.006747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:35.007296 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:35.007577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:35.007850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] PATH_INFO: `/v3/users/9ef6f96422f9470a93983d3ff2b8c3c6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:35.020228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef6f96422f9470a93983d3ff2b8c3c6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:35.021252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:35.021252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:25:35.021252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:25:35.022471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:35.032485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:35.087822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef6f96422f9470a93983d3ff2b8c3c6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:35.096990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef6f96422f9470a93983d3ff2b8c3c6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:35.097446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef6f96422f9470a93983d3ff2b8c3c6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:35.110811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef6f96422f9470a93983d3ff2b8c3c6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:35.133690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef6f96422f9470a93983d3ff2b8c3c6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:35.139086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 741/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:25:34 2022] DELETE /identity/v3/users/9ef6f96422f9470a93983d3ff2b8c3c6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:25:35.144107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1258-c644-4154-b856-465b6072182a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:35.144613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1258-c644-4154-b856-465b6072182a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:35.144613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1258-c644-4154-b856-465b6072182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:35.200283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d58c1258-c644-4154-b856-465b6072182a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:25:35.201481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d58c1258-c644-4154-b856-465b6072182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:35.277886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:35.290219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 767/1508] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:25:35.300314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:35.301514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:35.398586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad025f-4635-4d3b-8670-5a5e375ec6c1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:35.451674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:35.471981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:35.472586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:35.472860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:35.473127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:35.474685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:35.585303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:35.586771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84cca-59d2-4fa1-8e8a-2b942ed46e67 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:35.604982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 742/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:25:35.922689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1258-c644-4154-b856-465b6072182a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:25:35.923915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d58c1258-c644-4154-b856-465b6072182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:25:35.936084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1258-c644-4154-b856-465b6072182a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:25:36.034210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:25:36.034839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:25:36.035109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:25:36.035372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] PATH_INFO: `/v3/projects/6441b54b71a446bd91daa85830b74ab6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:25:36.044891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6441b54b71a446bd91daa85830b74ab6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:25:36.045899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:25:36.045899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:25:36.045899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:25:36.047080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:25:36.103225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6441b54b71a446bd91daa85830b74ab6', 'request_id': 'req-016ae373-5e86-48f6-962d-f8a26d2444c9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:36.111864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6441b54b71a446bd91daa85830b74ab6', 'request_id': 'req-016ae373-5e86-48f6-962d-f8a26d2444c9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:36.118319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6441b54b71a446bd91daa85830b74ab6', 'request_id': 'req-016ae373-5e86-48f6-962d-f8a26d2444c9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:36.149448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] The token cache is being invalidate because project 6441b54b71a446bd91daa85830b74ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:25:36.150062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:36.150173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-016ae373-5e86-48f6-962d-f8a26d2444c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:25:36.151502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 768/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:25:35 2022] DELETE /identity/v3/projects/6441b54b71a446bd91daa85830b74ab6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:25:45.602745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=62 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:25:46.147493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:07.776449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9281a8-58d0-4cfc-91be-746dc7264898 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:07.777072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9281a8-58d0-4cfc-91be-746dc7264898 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:07.777072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9281a8-58d0-4cfc-91be-746dc7264898 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:07.778967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:07.783829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593477d-71f9-4437-8c5a-bf326c8c9a89 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:07.784315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593477d-71f9-4437-8c5a-bf326c8c9a89 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:07.784419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593477d-71f9-4437-8c5a-bf326c8c9a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:07.863218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b593477d-71f9-4437-8c5a-bf326c8c9a89 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:07.864706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b593477d-71f9-4437-8c5a-bf326c8c9a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:07.971962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:08.122834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9281a8-58d0-4cfc-91be-746dc7264898 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:08.125029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bd9281a8-58d0-4cfc-91be-746dc7264898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:08.245084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9281a8-58d0-4cfc-91be-746dc7264898 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:08.251079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c57a-a6e5-436e-a3b3-5d6cf9eee6ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:08.251679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c57a-a6e5-436e-a3b3-5d6cf9eee6ed service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:08.251983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c57a-a6e5-436e-a3b3-5d6cf9eee6ed service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:08.252259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c57a-a6e5-436e-a3b3-5d6cf9eee6ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:08.260179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c57a-a6e5-436e-a3b3-5d6cf9eee6ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:08.261765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c57a-a6e5-436e-a3b3-5d6cf9eee6ed service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:08.271630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 744/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:09.350001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4fa04-91b1-43ca-825b-6ee6882b204b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:09.350559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4fa04-91b1-43ca-825b-6ee6882b204b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:09.350559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4fa04-91b1-43ca-825b-6ee6882b204b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:09.351886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:09.358040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8eaa-d199-4d57-9872-6d4f101c6493 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:09.358456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8eaa-d199-4d57-9872-6d4f101c6493 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:09.358592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8eaa-d199-4d57-9872-6d4f101c6493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:09.377945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-314d8eaa-d199-4d57-9872-6d4f101c6493 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:09.379132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-314d8eaa-d199-4d57-9872-6d4f101c6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:09.387013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:09.538093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4fa04-91b1-43ca-825b-6ee6882b204b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:09.552403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4fa04-91b1-43ca-825b-6ee6882b204b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:09.557750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a9fc3-5201-46fb-878d-0179fd19683e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:09.558344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a9fc3-5201-46fb-878d-0179fd19683e service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:09.558624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a9fc3-5201-46fb-878d-0179fd19683e service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:09.558895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a9fc3-5201-46fb-878d-0179fd19683e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:09.567268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a9fc3-5201-46fb-878d-0179fd19683e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:09.568881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a9fc3-5201-46fb-878d-0179fd19683e service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:09.578629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 771/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:10.225699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943507c-a391-4f92-af8e-05060889fbda None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:10.226006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943507c-a391-4f92-af8e-05060889fbda None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:10.226284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943507c-a391-4f92-af8e-05060889fbda None None] PATH_INFO: `/v3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:10.227592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 746/1517] 10.222.0.49 () {54 vars in 925 bytes} [Thu Sep 22 12:27:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:27:10.233958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82c52e-111e-467a-bb9d-119ffd22a165 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:10.234245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82c52e-111e-467a-bb9d-119ffd22a165 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:10.234518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82c52e-111e-467a-bb9d-119ffd22a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:10.294381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fa82c52e-111e-467a-bb9d-119ffd22a165 None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:10.295587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fa82c52e-111e-467a-bb9d-119ffd22a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:10.311781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:10.365470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 772/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Sep 22 12:27:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:14.166631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f34a-61a4-4806-8377-3a26a03ef1bf None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:14.167166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f34a-61a4-4806-8377-3a26a03ef1bf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:14.167166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f34a-61a4-4806-8377-3a26a03ef1bf None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:14.169272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 747/1519] 10.222.0.25 () {54 vars in 961 bytes} [Thu Sep 22 12:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:14.173973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04084f5d-2a00-46aa-b375-24b035279583 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:14.174399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04084f5d-2a00-46aa-b375-24b035279583 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:14.174506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04084f5d-2a00-46aa-b375-24b035279583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:14.194205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-04084f5d-2a00-46aa-b375-24b035279583 None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:14.195251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-04084f5d-2a00-46aa-b375-24b035279583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:14.204302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 773/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Sep 22 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:14.211984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f34a-61a4-4806-8377-3a26a03ef1bf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:14.225507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f34a-61a4-4806-8377-3a26a03ef1bf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:14.230390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cc8ca-9d36-4881-b996-f9bb59182408 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:14.231641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc8ca-9d36-4881-b996-f9bb59182408 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:14.231923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc8ca-9d36-4881-b996-f9bb59182408 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:14.232226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc8ca-9d36-4881-b996-f9bb59182408 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:14.240539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cc8ca-9d36-4881-b996-f9bb59182408 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:14.242122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cc8ca-9d36-4881-b996-f9bb59182408 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:14.251472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 748/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:21.070181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0ddc-3948-4ee5-84c6-b47fc0ab681f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:21.070700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0ddc-3948-4ee5-84c6-b47fc0ab681f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:21.070700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0ddc-3948-4ee5-84c6-b47fc0ab681f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:21.071996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:21.078560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45000-e263-4af2-bec3-df8a8a8a7a8f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:21.078997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45000-e263-4af2-bec3-df8a8a8a7a8f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:21.079106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45000-e263-4af2-bec3-df8a8a8a7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:21.098263 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-47e45000-e263-4af2-bec3-df8a8a8a7a8f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:21.099455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-47e45000-e263-4af2-bec3-df8a8a8a7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:21.107338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:27:21.261801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0ddc-3948-4ee5-84c6-b47fc0ab681f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:21.276199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0ddc-3948-4ee5-84c6-b47fc0ab681f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:21.281536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc3a5e-601b-4520-9963-77d1dc13442d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:21.282130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3a5e-601b-4520-9963-77d1dc13442d service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:21.282408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3a5e-601b-4520-9963-77d1dc13442d service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:21.282679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc3a5e-601b-4520-9963-77d1dc13442d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:21.290574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3a5e-601b-4520-9963-77d1dc13442d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:21.292172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc3a5e-601b-4520-9963-77d1dc13442d service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:21.302085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 775/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:22.364807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4548cf-3ba2-4a13-aabe-a0ee25ea878c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:22.365337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4548cf-3ba2-4a13-aabe-a0ee25ea878c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:22.365337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4548cf-3ba2-4a13-aabe-a0ee25ea878c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:22.366685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 12:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:22.373410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba1f7-e09b-4b09-9f52-72d3fce204e6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:22.373843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba1f7-e09b-4b09-9f52-72d3fce204e6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:22.373962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba1f7-e09b-4b09-9f52-72d3fce204e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:22.393864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2aaba1f7-e09b-4b09-9f52-72d3fce204e6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:22.395133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2aaba1f7-e09b-4b09-9f52-72d3fce204e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:22.403011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:22.552930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4548cf-3ba2-4a13-aabe-a0ee25ea878c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:22.567207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4548cf-3ba2-4a13-aabe-a0ee25ea878c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:22.572526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e514c-99f4-4fa6-b19d-2308d6719507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:22.573140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e514c-99f4-4fa6-b19d-2308d6719507 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:22.573415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e514c-99f4-4fa6-b19d-2308d6719507 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:22.573684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e514c-99f4-4fa6-b19d-2308d6719507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:22.582029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e514c-99f4-4fa6-b19d-2308d6719507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:22.583595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e514c-99f4-4fa6-b19d-2308d6719507 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:22.592624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 751/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:26.580651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd394a5-c37e-4411-9d42-88bb268fd290 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:26.581190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd394a5-c37e-4411-9d42-88bb268fd290 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:26.581190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd394a5-c37e-4411-9d42-88bb268fd290 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:26.582447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:26.587542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3d39-59aa-4431-b9aa-6c6ee1504ea8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:26.587989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3d39-59aa-4431-b9aa-6c6ee1504ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:26.588112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3d39-59aa-4431-b9aa-6c6ee1504ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:26.607836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0cce3d39-59aa-4431-b9aa-6c6ee1504ea8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:26.609052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0cce3d39-59aa-4431-b9aa-6c6ee1504ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:26.616986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:26.902951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd394a5-c37e-4411-9d42-88bb268fd290 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:26.904728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2bd394a5-c37e-4411-9d42-88bb268fd290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:26.983419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd394a5-c37e-4411-9d42-88bb268fd290 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:26.986946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d25cb8-7d93-42a0-a539-7476ef48f2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:26.987541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d25cb8-7d93-42a0-a539-7476ef48f2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:26.987819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d25cb8-7d93-42a0-a539-7476ef48f2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:26.988170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d25cb8-7d93-42a0-a539-7476ef48f2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:26.997781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d25cb8-7d93-42a0-a539-7476ef48f2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:26.999199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d25cb8-7d93-42a0-a539-7476ef48f2f0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:27.008441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 778/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:29.167425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dee7-ee13-41a3-8201-42890ae9386d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:29.168557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dee7-ee13-41a3-8201-42890ae9386d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:29.168557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dee7-ee13-41a3-8201-42890ae9386d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:29.169940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:29.175277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d08e1-a10c-4ee4-864e-c4b047eab506 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:29.175708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d08e1-a10c-4ee4-864e-c4b047eab506 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:29.175809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d08e1-a10c-4ee4-864e-c4b047eab506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:29.195341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d33d08e1-a10c-4ee4-864e-c4b047eab506 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:29.196798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d33d08e1-a10c-4ee4-864e-c4b047eab506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:29.207263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:29.494627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dee7-ee13-41a3-8201-42890ae9386d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:29.506167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dee7-ee13-41a3-8201-42890ae9386d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:29.509908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196e7d7-02f6-445e-a358-fbface8a89f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:29.510950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196e7d7-02f6-445e-a358-fbface8a89f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:29.511410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196e7d7-02f6-445e-a358-fbface8a89f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:29.511691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196e7d7-02f6-445e-a358-fbface8a89f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:29.523379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196e7d7-02f6-445e-a358-fbface8a89f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:29.525556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196e7d7-02f6-445e-a358-fbface8a89f0 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:29.535099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 754/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:33.233377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d748f-efdf-43bc-820b-e9a6fddbb278 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:33.233903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d748f-efdf-43bc-820b-e9a6fddbb278 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:33.233903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d748f-efdf-43bc-820b-e9a6fddbb278 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:33.235273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:33.240976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afe2f-98d0-4e32-82f2-12302bd0a467 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:33.241378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afe2f-98d0-4e32-82f2-12302bd0a467 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:33.241523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afe2f-98d0-4e32-82f2-12302bd0a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:33.260562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-579afe2f-98d0-4e32-82f2-12302bd0a467 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:33.262268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-579afe2f-98d0-4e32-82f2-12302bd0a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:33.269991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:33.573838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d748f-efdf-43bc-820b-e9a6fddbb278 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:33.576184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a45d748f-efdf-43bc-820b-e9a6fddbb278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:33.639401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:33.652801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d748f-efdf-43bc-820b-e9a6fddbb278 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:33.656345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa054a-035c-4478-a407-43055cb86a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:33.656943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa054a-035c-4478-a407-43055cb86a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:33.657220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa054a-035c-4478-a407-43055cb86a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:33.657487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa054a-035c-4478-a407-43055cb86a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:33.666163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa054a-035c-4478-a407-43055cb86a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:33.667572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa054a-035c-4478-a407-43055cb86a59 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:33.676669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 781/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:27:35.810267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abf4f-1fec-4b18-86f4-db4d28745fb3 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:35.810859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abf4f-1fec-4b18-86f4-db4d28745fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:35.810859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abf4f-1fec-4b18-86f4-db4d28745fb3 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:35.812208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 12:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:27:35.817514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b11d2-581c-4a23-9412-8ab3cb109854 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:35.817965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b11d2-581c-4a23-9412-8ab3cb109854 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:35.818082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b11d2-581c-4a23-9412-8ab3cb109854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:35.837422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3a7b11d2-581c-4a23-9412-8ab3cb109854 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:27:35.838615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3a7b11d2-581c-4a23-9412-8ab3cb109854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:35.848293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:27:36.156994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3abf4f-1fec-4b18-86f4-db4d28745fb3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:27:36.158710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-de3abf4f-1fec-4b18-86f4-db4d28745fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:27:36.166378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=84 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:36.174252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3abf4f-1fec-4b18-86f4-db4d28745fb3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:27:36.178660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1ebc0-4eeb-4a39-8fc8-1ba124e4fe19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:27:36.179268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ebc0-4eeb-4a39-8fc8-1ba124e4fe19 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:27:36.179556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ebc0-4eeb-4a39-8fc8-1ba124e4fe19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:27:36.179822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1ebc0-4eeb-4a39-8fc8-1ba124e4fe19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:27:36.188915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1ebc0-4eeb-4a39-8fc8-1ba124e4fe19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:27:36.190349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1ebc0-4eeb-4a39-8fc8-1ba124e4fe19 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:27:36.200541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 757/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:27:45.832478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=11 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:46.195682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:09.556502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:09.559370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:09.559370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:09.584603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:09.586462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:09.602624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 783/1540] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:09.612783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:09.613374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:09.613374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:09.640817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:09.642078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:09.654403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 758/1541] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:09.659791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:09.675218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629603a1-5104-46a5-8939-edb6a4f23dd0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:09.683057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:09.684109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:09.684615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:09.685094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:09.686014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:09.686537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:09.688420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:09.702938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 784/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:09.712061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:09.727620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f0e0-be31-4a43-a303-d7289e024d90 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:09.738004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17939f5b-320d-4365-a316-a77a1a2c5c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:09.738832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939f5b-320d-4365-a316-a77a1a2c5c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:09.739257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939f5b-320d-4365-a316-a77a1a2c5c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:09.739690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939f5b-320d-4365-a316-a77a1a2c5c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:09.740381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939f5b-320d-4365-a316-a77a1a2c5c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:09.742865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17939f5b-320d-4365-a316-a77a1a2c5c4c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:09.803986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 759/1543] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:09 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:09.808393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:09.824680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73cc62-d596-4989-bbea-684a663057d5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:09.918323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:09.919472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:09.919988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:09.920695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:09.923221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:09.925794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:09.947965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:09.948336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:09.948618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:09.963779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 785/1544] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:09 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:09.970179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:09.990294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd8eb-5d92-45e6-882b-cfe21f67f195 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.002248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.003497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.004079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34de57-8f3b-46c5-8217-649a1df26172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.005051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34de57-8f3b-46c5-8217-649a1df26172 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.005649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34de57-8f3b-46c5-8217-649a1df26172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.006205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34de57-8f3b-46c5-8217-649a1df26172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.007089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34de57-8f3b-46c5-8217-649a1df26172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.009247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34de57-8f3b-46c5-8217-649a1df26172 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.023664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 760/1545] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.025737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 786/1546] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:10.031999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.033197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b6d0-d5f7-4857-a4a1-d0ea8655ed91 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.033686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b6d0-d5f7-4857-a4a1-d0ea8655ed91 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.034166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b6d0-d5f7-4857-a4a1-d0ea8655ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.050402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c38939-b905-456b-b38c-ad10204cf88e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.063025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22151f8b-f5a6-4a09-ab7d-0150226efb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.064248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151f8b-f5a6-4a09-ab7d-0150226efb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.064894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151f8b-f5a6-4a09-ab7d-0150226efb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.065381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22151f8b-f5a6-4a09-ab7d-0150226efb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.065965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2440b6d0-d5f7-4857-a4a1-d0ea8655ed91 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.066583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151f8b-f5a6-4a09-ab7d-0150226efb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.067291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2440b6d0-d5f7-4857-a4a1-d0ea8655ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.068979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22151f8b-f5a6-4a09-ab7d-0150226efb21 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.086516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 761/1547] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:10.092803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 787/1548] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:10.094860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055e5dd-95e1-43c0-872b-13ad510a7db9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.096303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.096815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055e5dd-95e1-43c0-872b-13ad510a7db9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.097311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.097792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055e5dd-95e1-43c0-872b-13ad510a7db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.098292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.143661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.145599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.146132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f055e5dd-95e1-43c0-872b-13ad510a7db9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.147596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f055e5dd-95e1-43c0-872b-13ad510a7db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.163444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 788/1549] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.164659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 762/1550] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.165603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.165857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.166356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.166837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.177181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644c78e-3d9d-4396-a7f4-20093412c1b7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.181804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb4189-b040-48c5-9377-97ca26943ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.182468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb4189-b040-48c5-9377-97ca26943ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.182745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb4189-b040-48c5-9377-97ca26943ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.183028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb4189-b040-48c5-9377-97ca26943ab1 admin admin] PATH_INFO: `/v3/projects/7cd37a54181d448c935fa94b59d9ae2a/users/d8526f34161848debbce7a8622cef3ac/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.189391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.190983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.200576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb4189-b040-48c5-9377-97ca26943ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd37a54181d448c935fa94b59d9ae2a, user_id=d8526f34161848debbce7a8622cef3ac, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.204419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb4189-b040-48c5-9377-97ca26943ab1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.207979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 789/1551] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.209095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.222489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46f7b9-9a1b-48c1-a714-eff35d720e3e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.229095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 763/1552] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:10 2022] PUT /identity/v3/projects/7cd37a54181d448c935fa94b59d9ae2a/users/d8526f34161848debbce7a8622cef3ac/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:10.230447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d2c85-8b6a-4a9d-9957-60383a73a1e0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.231284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d2c85-8b6a-4a9d-9957-60383a73a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.231284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d2c85-8b6a-4a9d-9957-60383a73a1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.250972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2a0d2c85-8b6a-4a9d-9957-60383a73a1e0 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.252216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2a0d2c85-8b6a-4a9d-9957-60383a73a1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.284569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.285220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.285631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.285914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.286561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.286863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.288576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96f09a-c146-46a6-a0cf-3fdc15145fdf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.300638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 790/1553] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.301841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b196-9e92-4fe9-b5d7-07777243270c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.302123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b196-9e92-4fe9-b5d7-07777243270c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.302396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b196-9e92-4fe9-b5d7-07777243270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.312472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 764/1554] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.313815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71db6b-5bc0-4c8f-b3a9-26a6a127ddba None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.314045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71db6b-5bc0-4c8f-b3a9-26a6a127ddba None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.314319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71db6b-5bc0-4c8f-b3a9-26a6a127ddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.322238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5dc3b196-9e92-4fe9-b5d7-07777243270c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.323445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5dc3b196-9e92-4fe9-b5d7-07777243270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.332349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 791/1555] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.333706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c75e-7b20-4724-a8ac-18956aade513 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.333842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2c71db6b-5bc0-4c8f-b3a9-26a6a127ddba None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.334169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c75e-7b20-4724-a8ac-18956aade513 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.334545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c75e-7b20-4724-a8ac-18956aade513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.334918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2c71db6b-5bc0-4c8f-b3a9-26a6a127ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.343067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 765/1556] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.344347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de342beb-8fad-42da-a195-9303780e20c5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.344659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de342beb-8fad-42da-a195-9303780e20c5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.344933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de342beb-8fad-42da-a195-9303780e20c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.355426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0bb7c75e-7b20-4724-a8ac-18956aade513 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.356660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0bb7c75e-7b20-4724-a8ac-18956aade513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.363759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-de342beb-8fad-42da-a195-9303780e20c5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.364543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 792/1557] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.365016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-de342beb-8fad-42da-a195-9303780e20c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.365770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.366057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.366583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.377300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 766/1558] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.378723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca941-ca51-4c8b-acb5-c2b024b53461 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.379119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca941-ca51-4c8b-acb5-c2b024b53461 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.379522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca941-ca51-4c8b-acb5-c2b024b53461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.386584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.387780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.396319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 793/1559] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.397119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.399864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-118ca941-ca51-4c8b-acb5-c2b024b53461 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.401140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-118ca941-ca51-4c8b-acb5-c2b024b53461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.408466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b148123-6c04-4765-937e-5c45216b4930 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.409213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 767/1560] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.410450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.410743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.411015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.416433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.417067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.417346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.417614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.418248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.419290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:29:10.419290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:29:10.419290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:29:10.420596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.430471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.431807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.432182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:10.440633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 768/1561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.441622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.451046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 794/1562] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:10.451209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe144028-8a05-4da1-bd82-ed930ccb8170 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.452504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.500603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:10.513728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.514869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.515148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.515413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.516079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.516405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.517443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:29:10.517443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:29:10.517443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:29:10.518318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e1f05-43ba-4fef-a8ca-af4bf3ce57e8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.519008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b63aa-df72-4076-aeb3-48d9fd02b5cf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.523786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.524420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.524700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.524971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.525611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.525909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.527519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.530175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 769/1563] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.530175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9dfd-b733-44cd-9ce0-713ff755a210 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.530175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9dfd-b733-44cd-9ce0-713ff755a210 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.530175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9dfd-b733-44cd-9ce0-713ff755a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.539539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 795/1564] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.540455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.550457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02ef2-d56d-4171-8d60-7d3c2c47eeb8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.555274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.555872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.556185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.556459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.557106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.557687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-743b9dfd-b733-44cd-9ce0-713ff755a210 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.557794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.558537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-743b9dfd-b733-44cd-9ce0-713ff755a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.558982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.569140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 770/1565] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.570269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18871d77-2784-4cec-80cc-be914112311f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.570555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18871d77-2784-4cec-80cc-be914112311f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.570826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18871d77-2784-4cec-80cc-be914112311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.571906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 796/1566] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.572767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.596591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-18871d77-2784-4cec-80cc-be914112311f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:10.597786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-18871d77-2784-4cec-80cc-be914112311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:10.605772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 771/1567] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:10.610264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18871d77-2784-4cec-80cc-be914112311f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.616425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18871d77-2784-4cec-80cc-be914112311f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.621070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.621653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.621933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.622207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.622852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.623145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.625420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.628263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b45d7-afc0-4eee-8a9b-1656d5779fd8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.631858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.632489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.632768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.633075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.636794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 772/1568] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.637556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.642231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.643727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.648841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e910-e1d9-406f-a30f-ed5ad9230dba admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.653440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 797/1569] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:10.654052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.654453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.655140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.655353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.655652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.656315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.657325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:29:10.657325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:29:10.657325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:29:10.658597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.663282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981b73-9827-4991-9b9f-cf129f90be15 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.667919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.668864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.668864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.669076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.671315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.673389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.684992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 773/1570] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:10.689221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.699817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8670fcc-5076-41b1-bf4c-bec19cda6f2e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.704524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.705127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.705404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.705673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.706298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.710515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 798/1571] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:10.710686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.710787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.740407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 774/1572] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:10.741661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.774827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:10.788291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c2f2-46a7-4d9f-b489-649f50e00ee1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.816541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7328c-4a29-4614-b6c8-e825da1a8504 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.823099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.823656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.823955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.824243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.824895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.827148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.858673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.859291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.859575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.859849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.860557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.860857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.862461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.863052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 775/1573] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:10.864112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.880027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 799/1574] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.881022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:10.906562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8cb17-11f1-465d-821c-8dd69081220a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.959850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eccd8-53db-4892-b93e-7dd5997e7f10 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:10.965546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.966192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.966470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.966875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.968194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:10.968401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.970002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.973219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:10.976031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:10.976676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:10.976962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:10.977238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:10.978178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:10.979797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:10.983992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 776/1575] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:10.985181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.002114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a692f-1326-44ef-ac67-ac5d0eebe9ed admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.008064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.008680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.008961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.009234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.010148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.011959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.023897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 800/1576] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:10 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.024096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 777/1577] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.024617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.024728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.035184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe5f13-ec8e-4c91-bdc4-971c3ef745c0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.093568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64c60f-68e3-49ab-b84f-b03e1af84c7e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.098711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.099812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.099812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.100032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.101045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.103200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.127017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.127820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.128225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.128576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.129279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.129759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 801/1578] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.130902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.134627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.142861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43887f1-5b09-45f9-b2c8-0456ce2c8a88 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.148559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.149691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.149691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.150014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.150522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.152904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.163852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:11.169219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 778/1579] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.173699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.188548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 802/1580] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.189787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.192266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07465eea-ae07-4a8e-809f-af146e345171 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.206529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.208201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.208529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.208800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f91afc-d3c6-4c08-9251-19169f156aea admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.209238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.209960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.212458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.213929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.214598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.214882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.215377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.216151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.218723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.251299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 779/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.252252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.257600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 803/1582] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.258612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.326116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dd7cf-220b-4c31-b33e-57b073f0f426 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.332592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.333216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.333610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.333891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.334526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.336478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.340349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ea9cf-f3e8-4458-888d-f7b9b6c13177 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.348705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.349433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.350113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.350433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.351189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.353388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.364703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 780/1583] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.366471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.366674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 804/1584] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.367507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.378179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783f738-68bd-42e4-ad26-8797f829a888 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.382452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00bedb-f587-488b-a18a-bbb432c08c81 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.384046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.384749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.385100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.385445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.386217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.387876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.388559 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.389934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.390193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.390461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.391211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.393133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.407267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 805/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.407267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.416140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9722cf-f4a7-4dee-957e-78dbf80cccd0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.420063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 781/1586] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.420063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.424380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.425077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.425430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.425770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.426490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.428198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.432329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68601a8-0bdb-4cae-b3eb-37f89e07cac8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.437879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.438971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.439466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.439901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.440724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.441900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 806/1587] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.443346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.445658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.466676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92acd99-9e5c-4ea7-8bad-904970b1b8ef admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.481169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.482131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.482425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.482787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.483846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.485855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.495847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 782/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/users => generated 287 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.495847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.515897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f47a9-ff5f-4a6f-a9ac-25a46c096b36 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.517338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 807/1589] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/users => generated 293 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:11.518223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.522030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.523110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.523593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.524085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.525409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.528517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.531145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab099e-c969-42b0-a88e-158534477fe8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.537323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.538163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.538595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.539741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] PATH_INFO: `/v3/projects/4ca2bb10120543108bf8d2e5e51f1979/users/b8c15490fa2b4c16accaa316a043795b/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.550459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 783/1590] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.551840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.558789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:11.561436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca2bb10120543108bf8d2e5e51f1979, user_id=b8c15490fa2b4c16accaa316a043795b, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.562724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:29:11.562724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:29:11.562724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:29:11.565372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.567626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be11f5-6def-43f1-be35-56ac062ac18a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.577263 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.577879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.578159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.578433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.579075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.581497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.593788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 808/1591] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:11 2022] PUT /identity/v3/projects/4ca2bb10120543108bf8d2e5e51f1979/users/b8c15490fa2b4c16accaa316a043795b/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:11.596932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.600499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 784/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.601541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.615523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1a8b-6f24-46e0-878d-ecf6b040bc45 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.680946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a05d9-51f4-4d88-9333-4919635d623b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.689226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.689846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.690130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.690401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.691111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.692884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.694963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.695718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:11.697506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.698355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.699025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.700218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.704866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.712793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 809/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.713889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.721382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 785/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.722833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.725397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49c56-9664-47fa-b594-00dd1f2f86e0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.731675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.732330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.732631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.732955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.733610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.735500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.737145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678073c9-950f-4fa4-b383-ed189e396fdc admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.744544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf269f18-0e19-4bde-b644-9544c3829531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.745622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf269f18-0e19-4bde-b644-9544c3829531 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.746802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 810/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.747492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf269f18-0e19-4bde-b644-9544c3829531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.747992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf269f18-0e19-4bde-b644-9544c3829531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.749444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf269f18-0e19-4bde-b644-9544c3829531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.751615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf269f18-0e19-4bde-b644-9544c3829531 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.751843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.765562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba190c-f364-42e0-8719-41023de52ec3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.771543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 786/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.771543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.771543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.771543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.775852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.777614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.777902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.778183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.778836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.781198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.793264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 811/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:11.794167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:11.794731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.796140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:11.806412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 787/1598] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:11.806739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167b771-e893-494d-9ba6-8bd814100195 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.807739 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.812670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.813460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.813811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.814407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] PATH_INFO: `/v3/projects/6b943914bd144254b332fedee587a08c/users/379a6ec0249d49e4971b44ece81b144e/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.829025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fae08-61c9-4b52-8b91-cfd8613c31d7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.834201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b943914bd144254b332fedee587a08c, user_id=379a6ec0249d49e4971b44ece81b144e, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.835201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.836154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.836756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.837360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] PATH_INFO: `/v3/projects/562fb86b22cc42a4bf096b135ba48e70/users/e660c9cf3dd14c489cb287a10656e940/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.837730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.862104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 812/1599] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:11 2022] PUT /identity/v3/projects/6b943914bd144254b332fedee587a08c/users/379a6ec0249d49e4971b44ece81b144e/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:11.862104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.862909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562fb86b22cc42a4bf096b135ba48e70, user_id=e660c9cf3dd14c489cb287a10656e940, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.866981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:11.887872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 788/1600] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:11 2022] PUT /identity/v3/projects/562fb86b22cc42a4bf096b135ba48e70/users/e660c9cf3dd14c489cb287a10656e940/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:11.889893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:11.945831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594d0da-88ad-4f01-8589-9fb66fcd8298 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.970627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f8c2-c888-4bc9-85e1-78d94df62f34 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:11.975914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:11.976149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:11.976415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:11.977008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:11.977786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:11.987671 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.006812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 789/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:12.007919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.020422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cea944-2345-445c-97fa-55f1c7b7e7a0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.026720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.027423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.027752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.028160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.028869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.030795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.031732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.032085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.032566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.033034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] PATH_INFO: `/v3/projects/2b3ed217e3ec4b29a391147efd2c359f/users/1904515c3a5c4b7c8844048fd9284cc8/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.044081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 790/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:12.045044 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.055496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb287f-546a-4771-95b2-bdf5c7c1e1c6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.060271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3ed217e3ec4b29a391147efd2c359f, user_id=1904515c3a5c4b7c8844048fd9284cc8, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.060509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ee1ff-6fb3-498f-9489-3989c3c5b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.061660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ee1ff-6fb3-498f-9489-3989c3c5b898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.061975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ee1ff-6fb3-498f-9489-3989c3c5b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.062361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ee1ff-6fb3-498f-9489-3989c3c5b898 admin admin] PATH_INFO: `/v3/projects/25a6dd87a0cb488aae660194a184a4be/users/5810f965252b4732bcb8435cba678da3/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.065845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.082210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ee1ff-6fb3-498f-9489-3989c3c5b898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a6dd87a0cb488aae660194a184a4be, user_id=5810f965252b4732bcb8435cba678da3, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.083123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 813/1603] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:11 2022] PUT /identity/v3/projects/2b3ed217e3ec4b29a391147efd2c359f/users/1904515c3a5c4b7c8844048fd9284cc8/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:12.084337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.085776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ee1ff-6fb3-498f-9489-3989c3c5b898 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.105195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 791/1604] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:12 2022] PUT /identity/v3/projects/25a6dd87a0cb488aae660194a184a4be/users/5810f965252b4732bcb8435cba678da3/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:12.113954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa72d-ef77-420f-8a96-8cea53ce63d4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.114697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa72d-ef77-420f-8a96-8cea53ce63d4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.115116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa72d-ef77-420f-8a96-8cea53ce63d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.138460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:12.148088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f30fa72d-ef77-420f-8a96-8cea53ce63d4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:12.150310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f30fa72d-ef77-420f-8a96-8cea53ce63d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.151296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:12.167572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529b81e-5f7c-4a4f-aaf1-0934a9cb79b2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.240832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.241778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.242118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.242472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.250224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 792/1605] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:12.252602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.253119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.253606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.257678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.259144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.276670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 814/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:12.278084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.279249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:12.280809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.291191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005773c2-9032-43fa-a53e-b50ce65563ff service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.297097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 793/1607] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:12.298329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.309181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564b90-8188-4c29-95ee-ab61c412cf70 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.317052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a754afe-1594-4e8d-a3a7-c6dc19c09876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.317052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a754afe-1594-4e8d-a3a7-c6dc19c09876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.317327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a754afe-1594-4e8d-a3a7-c6dc19c09876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.317570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a754afe-1594-4e8d-a3a7-c6dc19c09876 admin admin] PATH_INFO: `/v3/projects/4f78079080954855b71403111cdb9f11/users/74e861316ee64120af1babac4423bbc0/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.319193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405fdf1-ccf4-4523-bece-efe82e33f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.319869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405fdf1-ccf4-4523-bece-efe82e33f5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.320705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405fdf1-ccf4-4523-bece-efe82e33f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.320705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405fdf1-ccf4-4523-bece-efe82e33f5e7 admin admin] PATH_INFO: `/v3/projects/f37c199b1ec7405a8b5bbc3fc1646c8d/users/6dcde2af91ca4fddafb17397b5bc41ba/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.337352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a754afe-1594-4e8d-a3a7-c6dc19c09876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f78079080954855b71403111cdb9f11, user_id=74e861316ee64120af1babac4423bbc0, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.340899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a754afe-1594-4e8d-a3a7-c6dc19c09876 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.350713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405fdf1-ccf4-4523-bece-efe82e33f5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37c199b1ec7405a8b5bbc3fc1646c8d, user_id=6dcde2af91ca4fddafb17397b5bc41ba, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.353584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405fdf1-ccf4-4523-bece-efe82e33f5e7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.372729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 794/1608] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:12 2022] PUT /identity/v3/projects/4f78079080954855b71403111cdb9f11/users/74e861316ee64120af1babac4423bbc0/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:12.376448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.376733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.377008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.389212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 815/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:12 2022] PUT /identity/v3/projects/f37c199b1ec7405a8b5bbc3fc1646c8d/users/6dcde2af91ca4fddafb17397b5bc41ba/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:12.394253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.394839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.395797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.423371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:12.425603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.448323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] MFA Rules not processed for user `5810f965252b4732bcb8435cba678da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:12.449894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.524396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 795/1610] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:12.526783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.648262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 816/1611] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:12.649273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.657519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020780-3c06-4459-bead-f0d19fc766cf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.662069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608a59b-de3f-4e92-874d-d81c299bd408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.662666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a59b-de3f-4e92-874d-d81c299bd408 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.664379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a59b-de3f-4e92-874d-d81c299bd408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.664681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608a59b-de3f-4e92-874d-d81c299bd408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.671077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa8b51-6337-442a-9aaf-e653c55a9182 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.676306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224af26-18a5-4e57-9601-9d8d3499cd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.677062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224af26-18a5-4e57-9601-9d8d3499cd54 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.677453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224af26-18a5-4e57-9601-9d8d3499cd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.677756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a59b-de3f-4e92-874d-d81c299bd408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.677888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224af26-18a5-4e57-9601-9d8d3499cd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.679484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608a59b-de3f-4e92-874d-d81c299bd408 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.694662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 796/1612] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:12.697389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224af26-18a5-4e57-9601-9d8d3499cd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.699359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224af26-18a5-4e57-9601-9d8d3499cd54 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.699837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.700762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.701219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.724599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 817/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:12.727237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bb68-3f92-4057-9849-aa73b64ca8fa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.729569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bb68-3f92-4057-9849-aa73b64ca8fa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.730109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bb68-3f92-4057-9849-aa73b64ca8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.751923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] MFA Rules not processed for user `74e861316ee64120af1babac4423bbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:12.753132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.766410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:12.777664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c491bb68-3f92-4057-9849-aa73b64ca8fa None None] MFA Rules not processed for user `6dcde2af91ca4fddafb17397b5bc41ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:12.780761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c491bb68-3f92-4057-9849-aa73b64ca8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.840096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:12.861098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 797/1614] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:12.862066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.863427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:12.879436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 818/1615] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:12.880506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061d065-e1ea-4961-902d-421c62a4bca0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.885048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6001f9-3d27-48b4-9a48-00f456df2a4f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.885352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6001f9-3d27-48b4-9a48-00f456df2a4f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.885631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6001f9-3d27-48b4-9a48-00f456df2a4f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.887697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 819/1616] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 22 12:29:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:12.888810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6001f9-3d27-48b4-9a48-00f456df2a4f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:12.896387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc078b-8870-44c9-a877-1731de71e2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.900005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc078b-8870-44c9-a877-1731de71e2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.900005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc078b-8870-44c9-a877-1731de71e2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.900005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc078b-8870-44c9-a877-1731de71e2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.914715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6001f9-3d27-48b4-9a48-00f456df2a4f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:12.920291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7caee-8822-49f8-93be-0e28a824246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:12.921113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7caee-8822-49f8-93be-0e28a824246e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.921423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7caee-8822-49f8-93be-0e28a824246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.921700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7caee-8822-49f8-93be-0e28a824246e admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.922524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7caee-8822-49f8-93be-0e28a824246e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.926062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7caee-8822-49f8-93be-0e28a824246e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.930091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc078b-8870-44c9-a877-1731de71e2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:12.933696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc078b-8870-44c9-a877-1731de71e2ca service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:12.954326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 798/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:12.955828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.956715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.956715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.982110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 820/1618] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:12.987959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72e0f-3f39-48e9-b2a8-2ec8230556e6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:12.988433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72e0f-3f39-48e9-b2a8-2ec8230556e6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:12.988974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e72e0f-3f39-48e9-b2a8-2ec8230556e6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:12.990924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 821/1619] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 22 12:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:12.992160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e72e0f-3f39-48e9-b2a8-2ec8230556e6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.048184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:13.050212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:13.096411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e72e0f-3f39-48e9-b2a8-2ec8230556e6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.109828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b6f02-f36a-44c4-a664-a191d98593e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.110384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b6f02-f36a-44c4-a664-a191d98593e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.110669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b6f02-f36a-44c4-a664-a191d98593e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.112298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b6f02-f36a-44c4-a664-a191d98593e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.113838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b6f02-f36a-44c4-a664-a191d98593e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.119151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b6f02-f36a-44c4-a664-a191d98593e5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.157805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 822/1620] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:13.158654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.159097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.159436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.189259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 799/1621] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 22 12:29:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:13.203470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.218090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:13.220433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:13.229169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056765c-b336-4347-a3de-2ae154d8e324 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.242404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.244122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.244493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.245757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.247717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.251728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.254452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 823/1622] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 22 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:13.256121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.272897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d162b18-47fa-498c-81e2-b5843e82648d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.279208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.280055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.280384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.280661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.288156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 800/1623] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:13.288156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.323216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacc3e0-db65-4396-ad84-e9098e69ca6b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.339010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.339801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.340534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.341505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.401650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.404225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.422157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 824/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:13.423076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.438619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86f054-530e-4468-81d6-8f1b9eabc74e service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.445918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.446752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.447096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.447440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] PATH_INFO: `/v3/projects/744c29f078824e0d9f57728f0a3eab62/users/cc8c0cbf5cd343398e0811b24a511dc4/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.477531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744c29f078824e0d9f57728f0a3eab62, user_id=cc8c0cbf5cd343398e0811b24a511dc4, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.482407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.505589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 825/1625] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:13 2022] PUT /identity/v3/projects/744c29f078824e0d9f57728f0a3eab62/users/cc8c0cbf5cd343398e0811b24a511dc4/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:13.509959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.513721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.517272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.541009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:13.550018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 801/1626] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:13.637655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a0d00-7c50-49cd-b73b-d5f522fafbd6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.649349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a783-2726-48a2-be58-318df4d539ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.649977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a783-2726-48a2-be58-318df4d539ea admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.650394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a783-2726-48a2-be58-318df4d539ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.650536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a783-2726-48a2-be58-318df4d539ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.656122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7a783-2726-48a2-be58-318df4d539ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.657927 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7a783-2726-48a2-be58-318df4d539ea admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.686575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 826/1627] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:29:13.687703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:13.697733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:13.714375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7b9f0-35d5-4ca6-ade8-b898dae4ef49 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:13.728597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56204fd-311b-410a-8557-db4dc940c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:13.730196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56204fd-311b-410a-8557-db4dc940c6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.730665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56204fd-311b-410a-8557-db4dc940c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.732030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56204fd-311b-410a-8557-db4dc940c6ba admin admin] PATH_INFO: `/v3/projects/744c29f078824e0d9f57728f0a3eab62/users/cc8c0cbf5cd343398e0811b24a511dc4/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.739917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56204fd-311b-410a-8557-db4dc940c6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=744c29f078824e0d9f57728f0a3eab62, user_id=cc8c0cbf5cd343398e0811b24a511dc4, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:13.750538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56204fd-311b-410a-8557-db4dc940c6ba admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:13.796008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 802/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:13 2022] PUT /identity/v3/projects/744c29f078824e0d9f57728f0a3eab62/users/cc8c0cbf5cd343398e0811b24a511dc4/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:13.797893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.798187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.798470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.837951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] MFA Rules not processed for user `cc8c0cbf5cd343398e0811b24a511dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:13.840212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:13.918164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ea30-01af-42e5-a6af-68fe78a4e42a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.918557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ea30-01af-42e5-a6af-68fe78a4e42a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.918870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ea30-01af-42e5-a6af-68fe78a4e42a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.921547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 803/1629] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 22 12:29:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:13.926916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca1736-501d-45b2-8e18-95a001ac1566 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:13.927402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca1736-501d-45b2-8e18-95a001ac1566 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:13.927705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca1736-501d-45b2-8e18-95a001ac1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:13.966334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-88ca1736-501d-45b2-8e18-95a001ac1566 None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:13.971863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-88ca1736-501d-45b2-8e18-95a001ac1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:13.977597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 827/1630] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:13.996570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:14.104466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6b94-c0fd-4e5d-ac2f-989c6b0c865f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:14.111200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2558bb-4943-47b7-8eaf-938605558381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:14.112548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2558bb-4943-47b7-8eaf-938605558381 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:14.113022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2558bb-4943-47b7-8eaf-938605558381 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:14.113488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2558bb-4943-47b7-8eaf-938605558381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:14.122635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 804/1631] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:29:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:14.126619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb4c9-8311-453b-942b-d431f2f66937 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:14.127196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb4c9-8311-453b-942b-d431f2f66937 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:14.127537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfb4c9-8311-453b-942b-d431f2f66937 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:14.132684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2558bb-4943-47b7-8eaf-938605558381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:14.134558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2558bb-4943-47b7-8eaf-938605558381 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:14.138241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 805/1632] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 22 12:29:14 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:14.139325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfb4c9-8311-453b-942b-d431f2f66937 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:14.155178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 828/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:14.158719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:14.159135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:14.159787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:14.166669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfb4c9-8311-453b-942b-d431f2f66937 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:14.178324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:14.178968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:14.180452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:14.180728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:14.208512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:14.210252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:14.211783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:14.215173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:14.222056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 829/1634] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:14.238234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 806/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:14.371228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:14.383856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f029-f118-4677-85c3-612a838a3f0a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:14.391851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:14.393217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:14.394472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:14.397128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:14.422048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:14.423829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:14.445561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 830/1636] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:15.353120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:15.372854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cfeb5-d3e6-47d8-80e2-d4c0329ed98f service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:15.383058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fe063-9dc5-4d28-aa83-47c848f9f3f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:15.383800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fe063-9dc5-4d28-aa83-47c848f9f3f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:15.384071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fe063-9dc5-4d28-aa83-47c848f9f3f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:15.385783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fe063-9dc5-4d28-aa83-47c848f9f3f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:15.534826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fe063-9dc5-4d28-aa83-47c848f9f3f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:15.538146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fe063-9dc5-4d28-aa83-47c848f9f3f8 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:15.579000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 807/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:17.459502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:17.533156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:17.715881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d445d3-e713-4ded-b6d7-6ca53ebbd249 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:17.745893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:17.746564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:17.746841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:17.747109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] PATH_INFO: `/v3/users/5810f965252b4732bcb8435cba678da3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:17.749656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5810f965252b4732bcb8435cba678da3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:17.750691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:29:17.750691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 22 12:29:17.750691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: Sep 22 12:29:17.751904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:17.948759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5810f965252b4732bcb8435cba678da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:17.969269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5810f965252b4732bcb8435cba678da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:17.970579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5810f965252b4732bcb8435cba678da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:18.024512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5810f965252b4732bcb8435cba678da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:18.114975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5810f965252b4732bcb8435cba678da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:18.143749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 831/1638] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:17 2022] DELETE /identity/v3/users/5810f965252b4732bcb8435cba678da3 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:18.145534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:18.146049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:18.146147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:18.185028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:18.187583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:18.360238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 808/1639] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:18.422247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:18.424257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:18.603421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bce5a-dc49-48a4-927c-4cac01837f8e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:18.609847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58c2be-1aaa-4cbe-9963-d3ed0fc385b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:18.610882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58c2be-1aaa-4cbe-9963-d3ed0fc385b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:18.611173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58c2be-1aaa-4cbe-9963-d3ed0fc385b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:18.611449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58c2be-1aaa-4cbe-9963-d3ed0fc385b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:18.626088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58c2be-1aaa-4cbe-9963-d3ed0fc385b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:18.627613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58c2be-1aaa-4cbe-9963-d3ed0fc385b1 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:18.647923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 832/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:20.682382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:20.684896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:20.737036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cc062-e14b-4000-8e66-4bae9ba3a2fd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:20.744530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:20.745598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:20.746069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:20.746640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] PATH_INFO: `/v3/projects/25a6dd87a0cb488aae660194a184a4be` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:20.749156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a6dd87a0cb488aae660194a184a4be)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:20.750765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 12:29:20.750765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: warnings.warn(msg) Sep 22 12:29:20.750765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: Sep 22 12:29:20.752459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:20.754609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:20.801301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8994e7c-ba65-468f-8211-26a96ee7ed18 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:20.801846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8994e7c-ba65-468f-8211-26a96ee7ed18 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:20.801935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8994e7c-ba65-468f-8211-26a96ee7ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:20.841879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a6dd87a0cb488aae660194a184a4be', 'request_id': 'req-13958256-d815-4b83-a508-60567bc33641'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:20.861507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a6dd87a0cb488aae660194a184a4be', 'request_id': 'req-13958256-d815-4b83-a508-60567bc33641'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:20.872774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a6dd87a0cb488aae660194a184a4be', 'request_id': 'req-13958256-d815-4b83-a508-60567bc33641'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:20.873018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f8994e7c-ba65-468f-8211-26a96ee7ed18 None None] MFA Rules not processed for user `d8526f34161848debbce7a8622cef3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:20.879998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f8994e7c-ba65-468f-8211-26a96ee7ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:20.902822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] The token cache is being invalidate because project 25a6dd87a0cb488aae660194a184a4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:20.903490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:20.904536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13958256-d815-4b83-a508-60567bc33641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:20.906609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 809/1641] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:20 2022] DELETE /identity/v3/projects/25a6dd87a0cb488aae660194a184a4be => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:20.911815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5e92-50c0-4880-9060-4e23a122a1f5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:20.912863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5e92-50c0-4880-9060-4e23a122a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:20.913343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5e92-50c0-4880-9060-4e23a122a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:20.947569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-603f5e92-50c0-4880-9060-4e23a122a1f5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:20.949878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-603f5e92-50c0-4880-9060-4e23a122a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:20.965986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:21.058605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 833/1642] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:21.063706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.064094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.064384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.084769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 810/1643] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:21.093572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.094377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.095485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.120750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] MFA Rules not processed for user `d8526f34161848debbce7a8622cef3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:21.124528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:21.148648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 834/1644] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:21.169630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.186801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:21.191408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:21.192602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:21.226129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 811/1645] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:21.240584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.266043 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46505be5-4cb3-45d1-b4e5-c5517d24bc3c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:21.280277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:21.281586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.284778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.286557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.289076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:21.289456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:21.293080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:21.326471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 812/1646] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:21.331820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.356637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d09bf-bc3b-4113-9f04-df00638577c6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:21.370612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:21.371301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.371625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.371963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.376382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:21.381255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:21.460555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 813/1647] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:21 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:21.463373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.560023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:21.568714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5f6b-99a0-49e1-bf7c-4e52bb4c21d6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:21.587450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b05e4-c1db-47cf-ab96-56f0821d855c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:21.595311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:21.595960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.596344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.596505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.597146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:21.599995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:21.703042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 814/1648] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:21 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:21.706458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.749924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe3d7-3091-4ad7-b238-fcd6f7f3b338 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:21.763274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:21.765652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.765965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.766295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.768339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:21.792579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:21.846699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 815/1649] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:21.849101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.872983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b601a-c4c6-4b34-8bd2-41d467dbb651 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:21.885717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:21.888118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.888511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.888767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.892698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8b655-5819-4fb9-b08a-1c1eec1206bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:21.893899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:21.894196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8b655-5819-4fb9-b08a-1c1eec1206bf service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:21.894589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8b655-5819-4fb9-b08a-1c1eec1206bf service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:21.895024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8b655-5819-4fb9-b08a-1c1eec1206bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:21.897239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:21.958845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 816/1650] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:21.975448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:21.992201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e1e9b-5b91-49d8-b9aa-1040f6c2f8a8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:22.003071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:22.004443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:22.004729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:22.005436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] PATH_INFO: `/v3/projects/39751e6d97014256b94047653f278c10/users/3888147483be49de9a88befd5c5d6677/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:22.060103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39751e6d97014256b94047653f278c10, user_id=3888147483be49de9a88befd5c5d6677, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:22.063904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:22.090084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 817/1651] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:21 2022] PUT /identity/v3/projects/39751e6d97014256b94047653f278c10/users/3888147483be49de9a88befd5c5d6677/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:22.091478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:22.091675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8b655-5819-4fb9-b08a-1c1eec1206bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:22.094093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8b655-5819-4fb9-b08a-1c1eec1206bf service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:22.094214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:22.115403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 835/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 948 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:22.117029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:22.117318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:22.120013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:22.137096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:22.211370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] MFA Rules not processed for user `3888147483be49de9a88befd5c5d6677`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:22.221444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:22.325218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449a7dd-6749-4d0f-a64f-04bc913aa46f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:22.336137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:22.337928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:22.338272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:22.338546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] PATH_INFO: `/v3/users/74e861316ee64120af1babac4423bbc0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:22.342899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e861316ee64120af1babac4423bbc0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:22.348978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:22.443208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 836/1653] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:22.461248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:22.462708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:22.486085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e861316ee64120af1babac4423bbc0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:22.503915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e861316ee64120af1babac4423bbc0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:22.506513 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e861316ee64120af1babac4423bbc0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:22.532412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e861316ee64120af1babac4423bbc0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:22.567964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ea564828-3386-43a3-800a-d2f573167686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e861316ee64120af1babac4423bbc0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:22.586198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 818/1654] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:22 2022] DELETE /identity/v3/users/74e861316ee64120af1babac4423bbc0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:22.593951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:22.594384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:22.595733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:22.621570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:22.624868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:22.632894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:22.644260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0b69-78f0-4e4e-9dab-d7ace663475d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:22.731991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 819/1655] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:22.791759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:22.792513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:22.792798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:22.793074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:22.798171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:22.949345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:22.953065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc54d7-6e0c-4b0d-bc95-a3836f9c0720 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:22.976943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 837/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:29:23.118311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:23.119740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:23.298787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32085a7b-7893-466f-9253-53d00e3dbea3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:23.304761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b318ca-cfe5-4bd8-99b3-4d469f6089fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:23.305622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b318ca-cfe5-4bd8-99b3-4d469f6089fe service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:23.305994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b318ca-cfe5-4bd8-99b3-4d469f6089fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:23.306410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b318ca-cfe5-4bd8-99b3-4d469f6089fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:23.325079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b318ca-cfe5-4bd8-99b3-4d469f6089fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:23.327815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b318ca-cfe5-4bd8-99b3-4d469f6089fe service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:23.343790 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 820/1657] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:24.361905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84022-4b71-455f-b987-146c943e6d7d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:24.362360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84022-4b71-455f-b987-146c943e6d7d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:24.363083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84022-4b71-455f-b987-146c943e6d7d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:24.363841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 838/1658] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 22 12:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:24.369709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:24.370545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:24.371037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:24.460859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:24.462123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:24.481535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 821/1659] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:24.521820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84022-4b71-455f-b987-146c943e6d7d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:24.532936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:24.544109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84022-4b71-455f-b987-146c943e6d7d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:24.553396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b998b-9124-4bc8-ab5c-74fd18dc642f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:24.555572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b998b-9124-4bc8-ab5c-74fd18dc642f service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:24.557237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b998b-9124-4bc8-ab5c-74fd18dc642f service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:24.560924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b998b-9124-4bc8-ab5c-74fd18dc642f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:24.616268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b998b-9124-4bc8-ab5c-74fd18dc642f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:24.616268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b998b-9124-4bc8-ab5c-74fd18dc642f service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:24.617863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 839/1660] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:26.169177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:26.171392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:26.227835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a0692-804f-4326-80de-8c2401fa8733 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:26.241038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:26.242326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:26.242765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:26.243192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] PATH_INFO: `/v3/projects/4f78079080954855b71403111cdb9f11` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:26.247344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f78079080954855b71403111cdb9f11)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:26.249277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:26.310502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83b0d-6d7a-4af3-8a8d-87d9ca343281 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:26.311118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83b0d-6d7a-4af3-8a8d-87d9ca343281 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:26.311118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83b0d-6d7a-4af3-8a8d-87d9ca343281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:26.436290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1cf83b0d-6d7a-4af3-8a8d-87d9ca343281 None None] MFA Rules not processed for user `e660c9cf3dd14c489cb287a10656e940`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:26.453942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1cf83b0d-6d7a-4af3-8a8d-87d9ca343281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:26.458149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f78079080954855b71403111cdb9f11', 'request_id': 'req-57d45461-6cf8-4c68-80ff-da59e6d19276'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:26.500585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f78079080954855b71403111cdb9f11', 'request_id': 'req-57d45461-6cf8-4c68-80ff-da59e6d19276'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:26.534608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f78079080954855b71403111cdb9f11', 'request_id': 'req-57d45461-6cf8-4c68-80ff-da59e6d19276'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:26.557454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] The token cache is being invalidate because project 4f78079080954855b71403111cdb9f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:26.559358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:26.564016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-57d45461-6cf8-4c68-80ff-da59e6d19276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:26.569667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 822/1661] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:26 2022] DELETE /identity/v3/projects/4f78079080954855b71403111cdb9f11 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:26.571435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204fbc-c006-4a90-bf0e-2f30b65e2860 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:26.571862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204fbc-c006-4a90-bf0e-2f30b65e2860 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:26.572309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f204fbc-c006-4a90-bf0e-2f30b65e2860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:26.658578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 840/1662] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:26.659178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6f204fbc-c006-4a90-bf0e-2f30b65e2860 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:26.659178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6f204fbc-c006-4a90-bf0e-2f30b65e2860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:26.662348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:26.662734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:26.663068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:26.723359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] MFA Rules not processed for user `e660c9cf3dd14c489cb287a10656e940`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:26.727119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:26.729993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:26.746259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 841/1663] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:26.756241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:26.758694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:26.875475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 823/1664] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:26.878721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:26.883026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:26.884782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:26.934744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0061-3f20-4063-a5e8-11859dd8fa9f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:26.950179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:26.952241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:26.952643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:26.953004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:26.975170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:26.976883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:26.981060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:26.982320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:27.014671 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 824/1665] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:27.015322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 842/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:29:27.015673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.018109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:27.019743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.072994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef115d-ced3-48de-b30a-62a21717d907 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.102551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.106131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.106429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.106701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.125631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:27.126875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.135025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.194871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 843/1667] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:27.197505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.227669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d48355-ecb0-4141-936b-90e82590238c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.240921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.242811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.245416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.246040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.246730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.253573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.276826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4356-729d-4f0d-8d6e-328be8578323 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.291711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.292479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.292773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.293110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.300774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:27.328500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 844/1668] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:27 2022] POST /identity/v3/projects => generated 355 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:27.332191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.359189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.365010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.386710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:27.404303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 825/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:27.506813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2fcb-0034-44cf-bd2a-dd7b305814b9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.525847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.526498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.526784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.527060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.527810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.529766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.578297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 845/1670] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:27 2022] POST /identity/v3/users => generated 278 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:29:27.582385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.595573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c307d-6496-438f-ac1b-504c63535e8c service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.601968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.602897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.603614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.604157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.605945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.608300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.627505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 826/1671] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:27.631354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.646954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e3155-53f0-4ec1-938e-055d4fea95ca admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.658803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95a52-a438-40b0-8320-ad0db95babd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.659503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95a52-a438-40b0-8320-ad0db95babd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.659862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95a52-a438-40b0-8320-ad0db95babd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.660150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95a52-a438-40b0-8320-ad0db95babd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.671950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95a52-a438-40b0-8320-ad0db95babd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.671950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95a52-a438-40b0-8320-ad0db95babd5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.693400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 846/1672] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:27.697438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:27.717279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a895-40f5-417f-ab72-f63ba47250c3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:27.759568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:27.760309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.760595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.760873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] PATH_INFO: `/v3/projects/35e638c803744ff8b30ffdaa98300b4c/users/571eb8625a84491599a2e798ed4aa631/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.789736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e638c803744ff8b30ffdaa98300b4c, user_id=571eb8625a84491599a2e798ed4aa631, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:27.797031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:27.820285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 827/1673] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:27 2022] PUT /identity/v3/projects/35e638c803744ff8b30ffdaa98300b4c/users/571eb8625a84491599a2e798ed4aa631/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:27.832268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:27.832822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:27.833363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:27.898138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] MFA Rules not processed for user `571eb8625a84491599a2e798ed4aa631`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:27.899779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:28.059241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 847/1674] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:28.064871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:28.216359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c35a-f8b1-411e-b90c-6827ea827f75 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:28.223096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:28.224523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:28.224968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:28.225395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:28.227078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:28.229608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:28.250566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:28.275985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 828/1675] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:28 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:28.280154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:28.317280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43de37-ac73-4b77-9a65-207d58ee2802 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:28.460524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:28.462452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:28.463445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:28.463771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:28.468888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:28.475969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:28.573351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 848/1676] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:28 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:28.575035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:28.604908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c59db-ed30-4e39-8fff-2ff1304e69ed admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:28.614647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:28.615286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:28.615624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:28.616110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:28.617026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:28.620877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:28.651273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:28.657555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 829/1677] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:28.668210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877c14-bfde-437b-b096-9c9bad25ee76 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:28.680774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:28.681487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:28.681755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:28.682031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] PATH_INFO: `/v3/projects/a49f6ac1862946b5bc0e78beb6d995f5/users/31afe5f85d17438eb1111b573c6a7b4d/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:28.716549 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49f6ac1862946b5bc0e78beb6d995f5, user_id=31afe5f85d17438eb1111b573c6a7b4d, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:28.720583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:28.724383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:28.745022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 849/1678] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:28 2022] PUT /identity/v3/projects/a49f6ac1862946b5bc0e78beb6d995f5/users/31afe5f85d17438eb1111b573c6a7b4d/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:28.749177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:28.764574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20930340-f980-4426-9bdc-2659d7b56b22 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:28.967440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c984-a74d-47ea-b144-bbba126919a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:28.969208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c984-a74d-47ea-b144-bbba126919a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:28.970138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c984-a74d-47ea-b144-bbba126919a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:28.971342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c984-a74d-47ea-b144-bbba126919a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:28.974345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912c984-a74d-47ea-b144-bbba126919a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:28.979922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912c984-a74d-47ea-b144-bbba126919a4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:29.049975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 830/1679] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:29:29.053114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:29.071826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbc3d5-66ed-49ba-8e5f-5f9ff5e5649b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:29.088408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:29.089102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:29.089378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:29.089642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] PATH_INFO: `/v3/projects/a49f6ac1862946b5bc0e78beb6d995f5/users/31afe5f85d17438eb1111b573c6a7b4d/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:29.101765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49f6ac1862946b5bc0e78beb6d995f5, user_id=31afe5f85d17438eb1111b573c6a7b4d, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:29.104525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:29.152204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 850/1680] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:29 2022] PUT /identity/v3/projects/a49f6ac1862946b5bc0e78beb6d995f5/users/31afe5f85d17438eb1111b573c6a7b4d/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:29.153833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:29.154123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:29.154445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:29.241115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] MFA Rules not processed for user `31afe5f85d17438eb1111b573c6a7b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:29.250283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:29.431636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 831/1681] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:29.443713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:29.445802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:29.567480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717647f-0172-4eed-8e23-bc7639420a72 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:29.572534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2556a6d-d59e-4f5f-aaab-cc0aeb94b9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:29.573379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556a6d-d59e-4f5f-aaab-cc0aeb94b9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:29.573856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556a6d-d59e-4f5f-aaab-cc0aeb94b9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:29.574313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556a6d-d59e-4f5f-aaab-cc0aeb94b9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:29.594633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2556a6d-d59e-4f5f-aaab-cc0aeb94b9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:29.596443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2556a6d-d59e-4f5f-aaab-cc0aeb94b9e6 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:29.637653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 851/1682] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:29.911662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:29.929548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378afd7f-ae6d-4319-a5de-b419b6bb248a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:29.941767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c152a-6fe8-42b1-9218-3c934a1661cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:29.942479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c152a-6fe8-42b1-9218-3c934a1661cc service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:29.942759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c152a-6fe8-42b1-9218-3c934a1661cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:29.947250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c152a-6fe8-42b1-9218-3c934a1661cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:29.985898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036657d-7c3f-436d-a47f-659c1eb73d86 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:29.986177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036657d-7c3f-436d-a47f-659c1eb73d86 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:29.987461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036657d-7c3f-436d-a47f-659c1eb73d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:30.057564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d036657d-7c3f-436d-a47f-659c1eb73d86 None None] MFA Rules not processed for user `e660c9cf3dd14c489cb287a10656e940`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:30.063760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d036657d-7c3f-436d-a47f-659c1eb73d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:30.206783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c152a-6fe8-42b1-9218-3c934a1661cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:30.213275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c152a-6fe8-42b1-9218-3c934a1661cc service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:30.231724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:30.252839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 832/1683] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:30.302577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 852/1684] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:30.635064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:30.635525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:30.635721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:30.725023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] MFA Rules not processed for user `b8c15490fa2b4c16accaa316a043795b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:30.727413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:30.936482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 833/1685] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:31.191632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:31.192593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:31.193188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:31.438495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:31.439907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:31.470745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:31.479774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:31.765353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 853/1686] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:29:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 576 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:31.766054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea0694-ff54-4067-b4ed-0e0534c599b5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:31.787140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295d92-31e1-4f9d-a128-8b2252d647d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:31.788005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295d92-31e1-4f9d-a128-8b2252d647d7 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:31.788298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295d92-31e1-4f9d-a128-8b2252d647d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:31.788582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295d92-31e1-4f9d-a128-8b2252d647d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:31.812911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295d92-31e1-4f9d-a128-8b2252d647d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:31.814557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295d92-31e1-4f9d-a128-8b2252d647d7 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:31.839511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 834/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:32.122340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:32.123917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:32.127224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:32.551551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967082b-1d79-435c-902f-6ad06a87a65a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:32.591624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:32.595444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:32.598265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:32.600772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:32.653331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:32.655623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:32.713175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 854/1688] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:29:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:29:33.497411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:33.498012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:33.499304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:33.613774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] MFA Rules not processed for user `1904515c3a5c4b7c8844048fd9284cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:33.615841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:33.860518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 835/1689] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:33.869369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:33.888626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c7ad-fff3-4d79-90a8-893042fc81d0 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:33.939760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5ff7c-4740-4060-bc76-b6e7ad25de7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:33.942673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ff7c-4740-4060-bc76-b6e7ad25de7d service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:33.949496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ff7c-4740-4060-bc76-b6e7ad25de7d service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:33.951043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5ff7c-4740-4060-bc76-b6e7ad25de7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:33.973159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5ff7c-4740-4060-bc76-b6e7ad25de7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:33.982098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5ff7c-4740-4060-bc76-b6e7ad25de7d service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:34.031781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 855/1690] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:37.063804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:37.066094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:37.084889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:37.226484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52384d4-ae20-4d58-8f0b-b04a7ea78512 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:37.241645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:37.243406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:37.244356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:37.244895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] PATH_INFO: `/v3/users/3888147483be49de9a88befd5c5d6677` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:37.247043 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3888147483be49de9a88befd5c5d6677)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:37.250032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:37.391087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3888147483be49de9a88befd5c5d6677'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:37.419597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3888147483be49de9a88befd5c5d6677'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:37.428380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3888147483be49de9a88befd5c5d6677'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:37.468084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3888147483be49de9a88befd5c5d6677'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:37.544538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3888147483be49de9a88befd5c5d6677'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:37.569486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 836/1691] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:37 2022] DELETE /identity/v3/users/3888147483be49de9a88befd5c5d6677 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:37.573902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653be48-9e96-455f-997b-ce1837a96abd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:37.575212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653be48-9e96-455f-997b-ce1837a96abd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:37.575738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653be48-9e96-455f-997b-ce1837a96abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:37.676525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d653be48-9e96-455f-997b-ce1837a96abd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:37.691570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d653be48-9e96-455f-997b-ce1837a96abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:37.987808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 856/1692] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:38.082888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:38.085758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:38.293306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8355eb-b5d5-4245-8df9-687b30bca333 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:38.314971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:38.316032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:38.316421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:38.316788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:38.358939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb365f-c72d-4e6c-b265-907ef25374b3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:38.359926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:38.361544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb365f-c72d-4e6c-b265-907ef25374b3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:38.362104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb365f-c72d-4e6c-b265-907ef25374b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:38.365255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:38.408022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 837/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:29:38.421139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a1fb365f-c72d-4e6c-b265-907ef25374b3 None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:38.422524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a1fb365f-c72d-4e6c-b265-907ef25374b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:38.443513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 857/1694] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Sep 22 12:29:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:38.647695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:38.650349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:38.676278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3a5d-4f2e-45fb-a048-b322d3e8cc59 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:38.686405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:38.687164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:38.687724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:38.688122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:38.697773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:38.700431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:38.715334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 838/1695] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:42.487203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:42.488427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:42.488920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:42.552122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:42.554516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:42.589171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] MFA Rules not processed for user `379a6ec0249d49e4971b44ece81b144e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:42.590536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:42.593251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005a37-01fa-4a0b-bc57-d00aba0222c5 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:42.618872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:42.645822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:42.649391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:42.649391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] PATH_INFO: `/v3/projects/39751e6d97014256b94047653f278c10` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:42.668794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39751e6d97014256b94047653f278c10)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:42.685554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:42.719811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:42.726131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:42.806619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 858/1696] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:42.809366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:42.810912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:42.860319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39751e6d97014256b94047653f278c10', 'request_id': 'req-b7ed09a4-e844-467e-8ee3-0ffa8e208836'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:42.881557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39751e6d97014256b94047653f278c10', 'request_id': 'req-b7ed09a4-e844-467e-8ee3-0ffa8e208836'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:42.906882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39751e6d97014256b94047653f278c10', 'request_id': 'req-b7ed09a4-e844-467e-8ee3-0ffa8e208836'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:42.964922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] The token cache is being invalidate because project 39751e6d97014256b94047653f278c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:42.968256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:42.977010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b7ed09a4-e844-467e-8ee3-0ffa8e208836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:42.984443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 839/1697] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:42 2022] DELETE /identity/v3/projects/39751e6d97014256b94047653f278c10 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:42.997477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72132957-0ccf-4a36-bd96-6e5bfd70e467 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:42.997760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72132957-0ccf-4a36-bd96-6e5bfd70e467 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:42.998036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72132957-0ccf-4a36-bd96-6e5bfd70e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.004214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679dd5-c612-49f1-83e5-5d16ed927c50 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:43.110649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-72132957-0ccf-4a36-bd96-6e5bfd70e467 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:43.111946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-72132957-0ccf-4a36-bd96-6e5bfd70e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:43.249642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:43.250304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.250686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.250961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.261151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:43.297488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 840/1698] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:43.305552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.305924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.306290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.385787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:43.401224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:43.408828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:43.411112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:43.430840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 841/1699] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:43.433835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:43.459043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 859/1700] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:29:43.481506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784d0e-eb27-477e-b513-c9c3df698ac6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:43.499663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:43.500460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.500757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.501224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.501933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:43.502308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:43.506867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:43.531810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:43.548349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 842/1701] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:43.548864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a66f-f096-4aed-9546-d87962d259e9 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:43.560580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:43.561506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.561932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.562358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.563146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:43.567579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:43.612900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:43.652730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 860/1702] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:43 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:29:43.654016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:43.672796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cbf0e-b8b3-4fe5-b527-01d09c9796ae admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:43.841224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:43.843109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.843546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.844069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.844923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:43.847300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:43.889519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 843/1703] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:43 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:43.894725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:43.911484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efa2ff-f3cc-4104-803d-7d5c2f181d37 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:43.925268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:43.926607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.926607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.926830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.927488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:43.930513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:43.955030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 861/1704] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:43.956434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:43.980395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0362f1-e4fe-41e8-9a27-a31848e4b9ee admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:43.996161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2e5b-e0c6-4ed8-8170-b5bb11f888a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:43.996846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2e5b-e0c6-4ed8-8170-b5bb11f888a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:43.997128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2e5b-e0c6-4ed8-8170-b5bb11f888a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:43.997417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2e5b-e0c6-4ed8-8170-b5bb11f888a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:43.999194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e2e5b-e0c6-4ed8-8170-b5bb11f888a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:44.001379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e2e5b-e0c6-4ed8-8170-b5bb11f888a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:44.003141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:44.042954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 844/1705] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:44.044974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:44.062963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47962702-4b57-4c56-81a0-2c7aac0972a4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:44.076968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:44.077579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:44.077855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:44.078129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] PATH_INFO: `/v3/projects/52bd7ae64149438eb0b301e6df735a06/users/da7f2b51a50a4c4bb75fab1167bf203b/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:44.113532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bd7ae64149438eb0b301e6df735a06, user_id=da7f2b51a50a4c4bb75fab1167bf203b, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:44.117265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:44.191811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 862/1706] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:44 2022] PUT /identity/v3/projects/52bd7ae64149438eb0b301e6df735a06/users/da7f2b51a50a4c4bb75fab1167bf203b/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:44.203818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868b88-cc69-4e20-a321-059aba351263 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:44.204529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868b88-cc69-4e20-a321-059aba351263 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:44.207395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868b88-cc69-4e20-a321-059aba351263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:44.337423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5d868b88-cc69-4e20-a321-059aba351263 None None] MFA Rules not processed for user `da7f2b51a50a4c4bb75fab1167bf203b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:44.342185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5d868b88-cc69-4e20-a321-059aba351263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:44.653528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 845/1707] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:44.653715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:44.752991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e70892-61b2-4ec4-aa91-23dfd9f56af0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:44.753692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e70892-61b2-4ec4-aa91-23dfd9f56af0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:44.753692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e70892-61b2-4ec4-aa91-23dfd9f56af0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:44.755441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 846/1708] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:29:44.831263 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fd98-0d62-4a65-8127-9f89a7c5349b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:44.831552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fd98-0d62-4a65-8127-9f89a7c5349b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:44.831830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fd98-0d62-4a65-8127-9f89a7c5349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:44.864349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbd12a-b4f6-44fa-9e1f-5b9d63b98e2f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:44.884873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:44.885834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:44.885949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:44.886311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:44.887086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:44.891244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:44.919543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-36b2fd98-0d62-4a65-8127-9f89a7c5349b None None] MFA Rules not processed for user `1904515c3a5c4b7c8844048fd9284cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:44.922169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-36b2fd98-0d62-4a65-8127-9f89a7c5349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:45.029319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 863/1709] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:44 2022] POST /identity/v3/projects => generated 367 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:45.034029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:45.310696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 847/1710] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:45.320403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:45.320735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:45.321019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:45.359640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec0589-95a0-45d1-a592-0d94532530cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:45.378912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:45.381140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:45.387571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:45.390936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:45.391778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:45.397973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:45.440848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:45.452354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:45.480074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 864/1711] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:45 2022] POST /identity/v3/users => generated 290 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:29:45.481351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:45.529126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d3647-5019-4076-9629-ca40deec4934 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:45.546419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:45.566173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:45.572967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:45.574819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:45.575648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:45.583817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:45.637962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 865/1712] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:45.640191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:45.676992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db66b4-9720-4098-87a4-8c87b74e9e49 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:45.700684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:45.704804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:45.708339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:45.710000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] PATH_INFO: `/v3/projects/ba9f1477e67844b2b0e3a77fc3136d46/users/177283ca69d44f3fb35d8c9480ec3164/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:45.770918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9f1477e67844b2b0e3a77fc3136d46, user_id=177283ca69d44f3fb35d8c9480ec3164, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:45.818499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:45.821104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 848/1713] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:45.837174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:45.856174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 866/1714] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:45 2022] PUT /identity/v3/projects/ba9f1477e67844b2b0e3a77fc3136d46/users/177283ca69d44f3fb35d8c9480ec3164/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:45.860328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:45.878372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfb675-55ce-44ac-9cf6-92b1c8aa5fed None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:45.978154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:46.171399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:46.177143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:46.177468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:46.177693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:46.178366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:46.180203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:46.235724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 849/1715] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:46.236742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:46.281512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0313d1-8265-41c8-bd8a-22131d926bd0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:46.302715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4c5f0-0d80-4ae7-9712-750281f3e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:46.304735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4c5f0-0d80-4ae7-9712-750281f3e894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:46.306032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4c5f0-0d80-4ae7-9712-750281f3e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:46.307957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4c5f0-0d80-4ae7-9712-750281f3e894 admin admin] PATH_INFO: `/v3/projects/ba9f1477e67844b2b0e3a77fc3136d46/users/177283ca69d44f3fb35d8c9480ec3164/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:46.314988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4c5f0-0d80-4ae7-9712-750281f3e894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9f1477e67844b2b0e3a77fc3136d46, user_id=177283ca69d44f3fb35d8c9480ec3164, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:46.331336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4c5f0-0d80-4ae7-9712-750281f3e894 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:46.381628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:46.383481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:46.385659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 867/1716] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:46 2022] PUT /identity/v3/projects/ba9f1477e67844b2b0e3a77fc3136d46/users/177283ca69d44f3fb35d8c9480ec3164/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:46.401959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:46.402358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:46.402686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:46.508003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] MFA Rules not processed for user `177283ca69d44f3fb35d8c9480ec3164`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:46.509964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:46.606569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962339e-ed38-44f7-8595-ff66cb606311 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:46.701729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 868/1717] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:46.715146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:46.717686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:46.849608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:46.852370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:46.853035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:46.853457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:46.885691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:46.900677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:46.946806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1de84-aa3b-420b-800f-e554de1fb672 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:46.972280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 850/1718] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:46.979489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92e032-d2a5-4ad2-8d42-6d1f8a5a6a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:46.980439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e032-d2a5-4ad2-8d42-6d1f8a5a6a8a service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:46.982389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e032-d2a5-4ad2-8d42-6d1f8a5a6a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:46.982389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e032-d2a5-4ad2-8d42-6d1f8a5a6a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:47.014693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92e032-d2a5-4ad2-8d42-6d1f8a5a6a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:47.027824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92e032-d2a5-4ad2-8d42-6d1f8a5a6a8a service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:47.066041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 869/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:47.166648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:47.168335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:47.190403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b16cf-e644-4b32-80c8-db8fbd03b645 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:47.202418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ae9b9-1800-4763-88d7-965376e62a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:47.203267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ae9b9-1800-4763-88d7-965376e62a4a service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:47.203679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ae9b9-1800-4763-88d7-965376e62a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:47.204281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ae9b9-1800-4763-88d7-965376e62a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:47.315315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:47.367243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ae9b9-1800-4763-88d7-965376e62a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:47.375411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ae9b9-1800-4763-88d7-965376e62a4a service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:47.411584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 851/1720] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:47.531386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697481b-6ca6-42c1-ba0c-fc666d3aa0d3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:47.531882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697481b-6ca6-42c1-ba0c-fc666d3aa0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:47.532359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697481b-6ca6-42c1-ba0c-fc666d3aa0d3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:47.534511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 870/1721] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:47.913391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb056f2-e1ec-41b1-a284-a7ea6314abb7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:47.914077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb056f2-e1ec-41b1-a284-a7ea6314abb7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:47.914077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb056f2-e1ec-41b1-a284-a7ea6314abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:47.975597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2fb056f2-e1ec-41b1-a284-a7ea6314abb7 None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:47.999611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2fb056f2-e1ec-41b1-a284-a7ea6314abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:48.042573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 852/1722] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:48.574001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94916571-0e70-4b3e-be55-6a7c2b4971ab None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:48.575073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94916571-0e70-4b3e-be55-6a7c2b4971ab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:48.575361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94916571-0e70-4b3e-be55-6a7c2b4971ab None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:48.577635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 871/1723] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 22 12:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:48.585471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99267ff0-b977-4ed6-992e-47ede77f8e75 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:48.585922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99267ff0-b977-4ed6-992e-47ede77f8e75 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:48.586322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99267ff0-b977-4ed6-992e-47ede77f8e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:48.619957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-99267ff0-b977-4ed6-992e-47ede77f8e75 None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:48.621454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-99267ff0-b977-4ed6-992e-47ede77f8e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:48.752932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 853/1724] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:48.767676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94916571-0e70-4b3e-be55-6a7c2b4971ab None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:48.770502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-94916571-0e70-4b3e-be55-6a7c2b4971ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:48.794309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94916571-0e70-4b3e-be55-6a7c2b4971ab None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:48.799135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:48.800009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:48.800474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:48.800909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:48.809102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:48.811455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:48.826987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 872/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:49.181503 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60fa6c-be67-4b65-b9c9-b3c9e661f4aa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:49.181994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60fa6c-be67-4b65-b9c9-b3c9e661f4aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:49.182081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60fa6c-be67-4b65-b9c9-b3c9e661f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:49.207777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:49.232482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9f60fa6c-be67-4b65-b9c9-b3c9e661f4aa None None] MFA Rules not processed for user `b8c15490fa2b4c16accaa316a043795b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:49.233836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9f60fa6c-be67-4b65-b9c9-b3c9e661f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:49.239573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb4c4-3ce8-4438-a7b2-9b0047707dec service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:49.259692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:49.260587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:49.261626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:49.263083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:49.299904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:49.307673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:49.353014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 873/1726] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:49.353876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 854/1727] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:51.976339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:51.976989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:51.976989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:52.005390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] MFA Rules not processed for user `379a6ec0249d49e4971b44ece81b144e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:52.006620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:52.165315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 855/1728] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:52.559313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:52.561155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:52.646798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:52.661135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:52.682142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a21522-80a4-4381-9496-95ba44323e5c service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:52.689114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:52.690685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:52.691032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:52.691454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] PATH_INFO: `/v3/users/571eb8625a84491599a2e798ed4aa631` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:52.693643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571eb8625a84491599a2e798ed4aa631)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:52.696195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:52.710123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:52.795051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c15c05-2cd8-4eb8-91c7-efc6ac6b6d47 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:52.807512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571eb8625a84491599a2e798ed4aa631'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.814215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:52.814875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:52.815148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:52.816654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] PATH_INFO: `/v3/users/da7f2b51a50a4c4bb75fab1167bf203b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:52.825994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7f2b51a50a4c4bb75fab1167bf203b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:52.828458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:52.835521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571eb8625a84491599a2e798ed4aa631'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.836284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571eb8625a84491599a2e798ed4aa631'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.849403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571eb8625a84491599a2e798ed4aa631'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.873637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62b08d60-c9bf-48a3-b130-6917ca31e5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571eb8625a84491599a2e798ed4aa631'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.890253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 874/1729] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:52 2022] DELETE /identity/v3/users/571eb8625a84491599a2e798ed4aa631 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:52.896174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:52.897486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:52.899662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:52.926621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7f2b51a50a4c4bb75fab1167bf203b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.941445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7f2b51a50a4c4bb75fab1167bf203b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.942103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7f2b51a50a4c4bb75fab1167bf203b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.948836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:52.953233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:52.956042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7f2b51a50a4c4bb75fab1167bf203b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.972857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f276aa5-839f-42d0-9515-a813f6ad4606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7f2b51a50a4c4bb75fab1167bf203b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:52.985422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 856/1730] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:52 2022] DELETE /identity/v3/users/da7f2b51a50a4c4bb75fab1167bf203b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:52.988586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:52.989085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:52.989551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:53.015206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:53.016830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:53.096289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 875/1731] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:53.113646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:53.115326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:53.163984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 857/1732] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:53.188668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:53.190668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:53.241559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3e646-c80f-403a-9a4d-0369812e2d0c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:53.300903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:53.336242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa6594-bc5a-46a9-a78f-633974b38298 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:53.356817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:53.360702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:53.361062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:53.361414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:53.421095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:53.427205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:53.429994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:53.464053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 858/1733] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:53.478135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:53.482156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:53.483022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:53.483326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:53.533017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:53.540682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:53.567323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 876/1734] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:29:54.222023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:54.223849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:54.243339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463da33-777f-47b1-9f8f-587ece0ed5f6 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:54.249266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:54.250038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:54.250624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:54.251211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] PATH_INFO: `/v3/projects/35e638c803744ff8b30ffdaa98300b4c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:54.252915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e638c803744ff8b30ffdaa98300b4c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:54.255170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:54.292894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:54.295685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:54.315074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53c0d-20f9-4d68-9499-9ba5cdbb77cc service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:54.322541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e638c803744ff8b30ffdaa98300b4c', 'request_id': 'req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.332955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e638c803744ff8b30ffdaa98300b4c', 'request_id': 'req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.338999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e638c803744ff8b30ffdaa98300b4c', 'request_id': 'req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.351151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] The token cache is being invalidate because project 35e638c803744ff8b30ffdaa98300b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:54.351662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.353438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.355014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 859/1735] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:54 2022] DELETE /identity/v3/projects/35e638c803744ff8b30ffdaa98300b4c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:54.359520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:54.360821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:54.384332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:54.384995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:54.385273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:54.385542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] PATH_INFO: `/v3/projects/52bd7ae64149438eb0b301e6df735a06` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:54.386797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bd7ae64149438eb0b301e6df735a06)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:54.388764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:54.431259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d64a12-bbb1-4c2c-aae3-911b0e54ff7b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:54.438864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bd7ae64149438eb0b301e6df735a06', 'request_id': 'req-1e389207-a92b-4f74-b2a3-605926c6a3d5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.447479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bd7ae64149438eb0b301e6df735a06', 'request_id': 'req-1e389207-a92b-4f74-b2a3-605926c6a3d5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.453347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bd7ae64149438eb0b301e6df735a06', 'request_id': 'req-1e389207-a92b-4f74-b2a3-605926c6a3d5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.465029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] The token cache is being invalidate because project 52bd7ae64149438eb0b301e6df735a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:54.465413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.466067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.468245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 877/1736] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:54 2022] DELETE /identity/v3/projects/52bd7ae64149438eb0b301e6df735a06 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:54.472341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:54.473726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:54.489425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:54.490094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:54.490372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:54.490643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] PATH_INFO: `/v3/users/31afe5f85d17438eb1111b573c6a7b4d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:54.491856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31afe5f85d17438eb1111b573c6a7b4d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:54.494088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:54.530262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:54.548688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:54.552140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31afe5f85d17438eb1111b573c6a7b4d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.552856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e389207-a92b-4f74-b2a3-605926c6a3d5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:54.558553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:54.559292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:54.559563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:54.559831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] PATH_INFO: `/v3/users/177283ca69d44f3fb35d8c9480ec3164` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:54.560213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31afe5f85d17438eb1111b573c6a7b4d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.560951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31afe5f85d17438eb1111b573c6a7b4d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.561460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177283ca69d44f3fb35d8c9480ec3164)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:54.563797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:54.568925 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31afe5f85d17438eb1111b573c6a7b4d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.582624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31afe5f85d17438eb1111b573c6a7b4d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.591891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 860/1737] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:54 2022] DELETE /identity/v3/users/31afe5f85d17438eb1111b573c6a7b4d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:54.639273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177283ca69d44f3fb35d8c9480ec3164'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.651552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177283ca69d44f3fb35d8c9480ec3164'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.652618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177283ca69d44f3fb35d8c9480ec3164'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.662565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177283ca69d44f3fb35d8c9480ec3164'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.690328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177283ca69d44f3fb35d8c9480ec3164'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:54.705366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 878/1738] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:54 2022] DELETE /identity/v3/users/177283ca69d44f3fb35d8c9480ec3164 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:55.041403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.046466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:55.169935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a78be-26f6-4ba8-a53a-a6c8b14fd767 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.206515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.208423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:55.297426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.298081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.298361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.298629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] PATH_INFO: `/v3/projects/a49f6ac1862946b5bc0e78beb6d995f5` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.300022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49f6ac1862946b5bc0e78beb6d995f5)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.302362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:55.329015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1ca9-9000-46dd-921b-a9365d169eb6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.336500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.338036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.338313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.338889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] PATH_INFO: `/v3/projects/ba9f1477e67844b2b0e3a77fc3136d46` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.346509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9f1477e67844b2b0e3a77fc3136d46)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.353559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:55.402117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49f6ac1862946b5bc0e78beb6d995f5', 'request_id': 'req-87c4d613-dd7d-4086-b38a-df2e01d83684'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.425166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:55.436526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49f6ac1862946b5bc0e78beb6d995f5', 'request_id': 'req-87c4d613-dd7d-4086-b38a-df2e01d83684'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.447397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49f6ac1862946b5bc0e78beb6d995f5', 'request_id': 'req-87c4d613-dd7d-4086-b38a-df2e01d83684'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.453041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9f1477e67844b2b0e3a77fc3136d46', 'request_id': 'req-dab9cd86-791b-46a5-b8bd-ea244d4b06da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.464497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9f1477e67844b2b0e3a77fc3136d46', 'request_id': 'req-dab9cd86-791b-46a5-b8bd-ea244d4b06da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.468450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] The token cache is being invalidate because project a49f6ac1862946b5bc0e78beb6d995f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:55.468977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.470383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-87c4d613-dd7d-4086-b38a-df2e01d83684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.471711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9f1477e67844b2b0e3a77fc3136d46', 'request_id': 'req-dab9cd86-791b-46a5-b8bd-ea244d4b06da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.473003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 861/1739] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:55 2022] DELETE /identity/v3/projects/a49f6ac1862946b5bc0e78beb6d995f5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:55.477587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1080-84d5-430e-9e9b-eb9eb9b9a5f4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.479816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1080-84d5-430e-9e9b-eb9eb9b9a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.480353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1080-84d5-430e-9e9b-eb9eb9b9a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.500276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] The token cache is being invalidate because project ba9f1477e67844b2b0e3a77fc3136d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:55.500568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.502555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dab9cd86-791b-46a5-b8bd-ea244d4b06da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:55.506852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 879/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:55 2022] DELETE /identity/v3/projects/ba9f1477e67844b2b0e3a77fc3136d46 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:55.511655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34404ac8-2cee-424d-bf4d-9203f9b27f6f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.511974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34404ac8-2cee-424d-bf4d-9203f9b27f6f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.512391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34404ac8-2cee-424d-bf4d-9203f9b27f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.520389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d0ff1080-84d5-430e-9e9b-eb9eb9b9a5f4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:55.521713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d0ff1080-84d5-430e-9e9b-eb9eb9b9a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:55.530707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:55.537421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-34404ac8-2cee-424d-bf4d-9203f9b27f6f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:55.539748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34404ac8-2cee-424d-bf4d-9203f9b27f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:55.615983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 862/1741] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:55.621594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.622141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.622644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.640998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 880/1742] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:55.648681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.649196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.649691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.652297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:55.653683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:55.667142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 863/1743] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:55.668672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.673527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:55.675544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:55.679453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb5976-32f7-4b97-816f-1930ed8e0c66 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.684778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 881/1744] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:55.685307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.686514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.686793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.687082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.687733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:55.688123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.689900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:55.690663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.699957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b4fdf-f77e-4ce3-8cdd-8b0ba303ef81 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.704697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.705319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.705595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.705862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.706251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 864/1745] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:29:55.706811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:55.707053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.708777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:55.711273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.725144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e93c3-d93a-4c25-905e-125623762a0f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.730104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 882/1746] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:55.731015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.731588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.731868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.732174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.733706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.733875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.735720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:55.752460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3ac06-324e-46a9-a4a8-5729c8de047a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.758848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.759469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.759788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.760201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.761578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.763828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:55.772590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 865/1747] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:55.776636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.828092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 883/1748] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:55.835058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:55.907007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d00d-95b8-41bd-b126-e8d20511cd67 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.931807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfca08-7963-4158-bd06-bb87e2340604 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:55.941910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:55.942787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:55.943067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:55.943397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:55.945381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:55.947490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.005398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 884/1749] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:56.007259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:56.010333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.011108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.012310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.012595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.013020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.013669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.021926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.044159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d491c-9834-43e4-a6ac-de69de863224 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.049774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.051038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.051487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.051896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.052712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.055037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.069197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 885/1750] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:56.073208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.081186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 866/1751] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:55 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:29:56.082255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.094083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa7d28-ac4d-43f1-a171-b6d674234c02 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.100725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.101581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.101733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d805bb1-c46c-4f00-be41-40945b450b8f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.102168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.103529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.104520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.106931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.107071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.107720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.108235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.108998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.109239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.110917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.121393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 886/1752] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:56.126011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 867/1753] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:56.128333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.129777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.140497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a778e-5522-43d4-a7fe-d612deae46fb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.144894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792396e-a939-416b-be76-1d79b72c482c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.146009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee781a-2502-4db2-9037-c6639dd6c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.146754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee781a-2502-4db2-9037-c6639dd6c7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.147105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee781a-2502-4db2-9037-c6639dd6c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.147453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee781a-2502-4db2-9037-c6639dd6c7f6 admin admin] PATH_INFO: `/v3/projects/902db5dc5d8c476aa3b692c5c8233891/users/8b427f7d40fc4386b2b712f4c331ca82/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.150407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.151774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.151774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.151774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.152390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.155370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.171107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee781a-2502-4db2-9037-c6639dd6c7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902db5dc5d8c476aa3b692c5c8233891, user_id=8b427f7d40fc4386b2b712f4c331ca82, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.174252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee781a-2502-4db2-9037-c6639dd6c7f6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.175568 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 868/1754] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:29:56.176601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.190550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889776b-3142-4707-b455-96a4db32b370 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.208970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 887/1755] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:56 2022] PUT /identity/v3/projects/902db5dc5d8c476aa3b692c5c8233891/users/8b427f7d40fc4386b2b712f4c331ca82/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:29:56.214199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.216640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.216939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.248887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:56.262969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] MFA Rules not processed for user `8b427f7d40fc4386b2b712f4c331ca82`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:56.266741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:56.281878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e419590-0fae-45ce-88bc-68a7afedbb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.282680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419590-0fae-45ce-88bc-68a7afedbb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.282968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419590-0fae-45ce-88bc-68a7afedbb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.283297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e419590-0fae-45ce-88bc-68a7afedbb49 admin admin] PATH_INFO: `/v3/projects/2056238ccdf5449ebb00d1c8c0c71f5f/users/d5f5a53f174c42dd86e0442e5f0a1c26/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.303449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e419590-0fae-45ce-88bc-68a7afedbb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2056238ccdf5449ebb00d1c8c0c71f5f, user_id=d5f5a53f174c42dd86e0442e5f0a1c26, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.306404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e419590-0fae-45ce-88bc-68a7afedbb49 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.336656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 869/1756] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:56 2022] PUT /identity/v3/projects/2056238ccdf5449ebb00d1c8c0c71f5f/users/d5f5a53f174c42dd86e0442e5f0a1c26/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:56.347905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.348472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.348980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.364181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 888/1757] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:56.369077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.386953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] MFA Rules not processed for user `d5f5a53f174c42dd86e0442e5f0a1c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:56.390771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:56.412934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa6e3-d9fa-476f-a57a-52a72ae19184 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.503516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 870/1758] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:29:56.504893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.529254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.535143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.535437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.535712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.540262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.544239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.603837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:56.618377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 889/1759] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:56 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:29:56.622497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.683152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e2df-ccd8-4c0a-89c3-1be23fd3f0c7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.784267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9c66-cfd9-4709-8ab6-442a02cdf2f2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.809432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.812106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.813276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.814683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.816761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.819194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.832953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:56.833365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:56.833722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:56.833899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:56.834543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:56.836485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:56.902475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 871/1760] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:56 2022] POST /identity/v3/projects => generated 377 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:56.904893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 890/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:56 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:56.906194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.906481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:56.935300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574710a-2687-493e-9f33-f647f046db1a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:56.961707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:57.052557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.054372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.054670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.055018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.056793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.059030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.092212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d68f5-a764-494c-b997-b97e7f6f4f40 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.100979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 891/1762] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:29:56 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:57.102403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.105241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.106540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.108563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.109495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.117375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9bc65-28ee-421b-aaa6-5bdb1420c9c0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.121066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.128342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.136182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.136991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.139665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.139980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.142777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.149324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.152839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 872/1763] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:57.160008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.176684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 892/1764] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:57.177983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.192385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0b70-700f-428f-905a-50d3f45ba909 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.210688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.211645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.213009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.213997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] PATH_INFO: `/v3/projects/ab244797e126453484eb8cdd7a9bcf39/users/adc72a3816564c5a9b170f96629426de/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.221305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24591af3-8a0e-44da-a4e9-a6b10633cf05 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.240749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.243065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.244189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.244574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] PATH_INFO: `/v3/projects/c91ba3605174418bae1c9748b876d293/users/01ad0a016d7049a8850ac2ef7127f64b/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.258014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab244797e126453484eb8cdd7a9bcf39, user_id=adc72a3816564c5a9b170f96629426de, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.263410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.299169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91ba3605174418bae1c9748b876d293, user_id=01ad0a016d7049a8850ac2ef7127f64b, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.302100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 893/1765] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:57 2022] PUT /identity/v3/projects/ab244797e126453484eb8cdd7a9bcf39/users/adc72a3816564c5a9b170f96629426de/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:57.308572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.312376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.346123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 873/1766] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:57 2022] PUT /identity/v3/projects/c91ba3605174418bae1c9748b876d293/users/01ad0a016d7049a8850ac2ef7127f64b/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:57.350732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.500371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:57.513271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcca79-54bd-4546-8bf8-8becf4ccb730 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.572058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1715bab-fb90-466e-8907-522efa192bab admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.584965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.585606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.585887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.586162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.586975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.590396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.614112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 874/1767] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:57.615189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.618563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:57.649652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134873-97f9-4ff2-99ca-c61b894f8b4e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.664694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.665391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.665661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.665984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] PATH_INFO: `/v3/users/6dcde2af91ca4fddafb17397b5bc41ba` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.668098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcde2af91ca4fddafb17397b5bc41ba)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.670895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.681535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.683725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.684141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.685641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.686452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.690115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.723595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 894/1768] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:29:57.724362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.764592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111077a-5035-4454-8bea-c1742456c66e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:57.774330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:57.777543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.777831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.778105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] PATH_INFO: `/v3/projects/c91ba3605174418bae1c9748b876d293/users/01ad0a016d7049a8850ac2ef7127f64b/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.783186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91ba3605174418bae1c9748b876d293, user_id=01ad0a016d7049a8850ac2ef7127f64b, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:57.789769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:57.793211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcde2af91ca4fddafb17397b5bc41ba'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:57.803637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:57.805280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcde2af91ca4fddafb17397b5bc41ba'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:57.806442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcde2af91ca4fddafb17397b5bc41ba'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:57.814294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 895/1769] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:57 2022] PUT /identity/v3/projects/c91ba3605174418bae1c9748b876d293/users/01ad0a016d7049a8850ac2ef7127f64b/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:57.827316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:57.833855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcde2af91ca4fddafb17397b5bc41ba'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:57.834596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:57.860032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6df157e4-ed9b-4a33-8241-b6acb99a1645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcde2af91ca4fddafb17397b5bc41ba'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:57.871807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 875/1770] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:57 2022] DELETE /identity/v3/users/6dcde2af91ca4fddafb17397b5bc41ba => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:57.874502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98304063-d09c-417b-b673-f568dd2483d7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.874831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98304063-d09c-417b-b673-f568dd2483d7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.875380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98304063-d09c-417b-b673-f568dd2483d7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.877721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 876/1771] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:29:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:29:57.879662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4304-ccc9-4a0a-9058-a48f57d9f83c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:57.880540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4304-ccc9-4a0a-9058-a48f57d9f83c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:57.881053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e4304-ccc9-4a0a-9058-a48f57d9f83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:57.955370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-155e4304-ccc9-4a0a-9058-a48f57d9f83c None None] MFA Rules not processed for user `01ad0a016d7049a8850ac2ef7127f64b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:57.956792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-155e4304-ccc9-4a0a-9058-a48f57d9f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:57.959439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220605-8cf2-4239-a34b-1bf92250218e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:58.088204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86c36b-7034-4c3a-bc88-6c1256780272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:58.089012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c36b-7034-4c3a-bc88-6c1256780272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.090383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c36b-7034-4c3a-bc88-6c1256780272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.090640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86c36b-7034-4c3a-bc88-6c1256780272 admin admin] PATH_INFO: `/v3/projects/ab244797e126453484eb8cdd7a9bcf39/users/adc72a3816564c5a9b170f96629426de/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.098033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c36b-7034-4c3a-bc88-6c1256780272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab244797e126453484eb8cdd7a9bcf39, user_id=adc72a3816564c5a9b170f96629426de, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:58.107406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86c36b-7034-4c3a-bc88-6c1256780272 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:58.134294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 896/1772] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:29:57 2022] PUT /identity/v3/projects/ab244797e126453484eb8cdd7a9bcf39/users/adc72a3816564c5a9b170f96629426de/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:58.138669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283772c3-07bb-44c5-b702-65ba1b79246c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.141518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283772c3-07bb-44c5-b702-65ba1b79246c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.141876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283772c3-07bb-44c5-b702-65ba1b79246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.168165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 877/1773] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:58.169928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.170618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.171377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.212383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:58.214003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.217381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-283772c3-07bb-44c5-b702-65ba1b79246c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:58.218708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-283772c3-07bb-44c5-b702-65ba1b79246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.243970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:58.315327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 897/1774] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:58.315327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.315327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.315327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.332686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 878/1775] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:58.334435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:58.338436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.379321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] MFA Rules not processed for user `adc72a3816564c5a9b170f96629426de`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:29:58.380760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.439384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f4d4-f4a8-423a-ac95-8debc6c4661b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:58.443747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:58.444415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.445020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.445273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.446342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:58.528705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 898/1776] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:29:58.528705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:58.528705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.546393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:58.548029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:58.560714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 879/1777] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:58.561814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:58.563873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.586394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102e83-72d9-419c-aba0-1f6c272c6bbd service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:58.593447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955f430-1244-46b7-a800-55ce0d5985df None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:58.594434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:58.595200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.595650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.596109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.598120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:58.611463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.611463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.611463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.612018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:58.612018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:58.617454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 880/1778] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:58.618515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:58.624096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.624784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:58.626452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:58.646301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 899/1779] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:58.647679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5df18-ec30-443b-9965-301077b4976c service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:58.659410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:58.660097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:58.660379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:58.660649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:58.669730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:58.775142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:58.780812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:58.784083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:58.800372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 881/1780] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:29:59.051535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.102136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90852b-cfac-4d23-aacf-7c486dad1a39 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:59.108089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ad0a016d7049a8850ac2ef7127f64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba3605174418bae1c9748b876d293', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:59.109287 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:59.109768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:59.110236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:59.111105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:59.111618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:59.113717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:59.138412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.148931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 900/1781] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:59.152528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8742eb-b9ca-493b-b996-d5a7465fcb11 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:59.158519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ad0a016d7049a8850ac2ef7127f64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba3605174418bae1c9748b876d293', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:59.159368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:59.159672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:59.160081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:59.160740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:59.163013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:59.217694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 882/1782] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:29:59 2022] POST /identity/v3/projects => generated 354 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:29:59.222547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.235219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309fddd-a8ad-4479-84ae-8960293e8637 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:59.306603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ad0a016d7049a8850ac2ef7127f64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba3605174418bae1c9748b876d293', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:59.307331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:59.307780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:59.308476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:59.309479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:29:59.309849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:59.312425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:59.333609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 901/1783] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:29:59.404419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.435786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768b08e-0629-4ee1-90a8-4dc76ac02047 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:59.452002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ad0a016d7049a8850ac2ef7127f64b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba3605174418bae1c9748b876d293', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:59.453437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:59.455475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:59.455987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] PATH_INFO: `/v3/projects/5996f43dd4484d60bbf0fa87f29e56c8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:59.464993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5996f43dd4484d60bbf0fa87f29e56c8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:59.467958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:59.515057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.521309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:59.578687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5996f43dd4484d60bbf0fa87f29e56c8', 'request_id': 'req-5398bbb3-6452-4835-8a4e-35095ef78333'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.592688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5996f43dd4484d60bbf0fa87f29e56c8', 'request_id': 'req-5398bbb3-6452-4835-8a4e-35095ef78333'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.600499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5996f43dd4484d60bbf0fa87f29e56c8', 'request_id': 'req-5398bbb3-6452-4835-8a4e-35095ef78333'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.614481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] The token cache is being invalidate because project 5996f43dd4484d60bbf0fa87f29e56c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:59.614481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.615358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.617530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 883/1784] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:59 2022] DELETE /identity/v3/projects/5996f43dd4484d60bbf0fa87f29e56c8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:59.620733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:59.666984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4d8cb-d00c-4e9e-bfa9-bc9e14abc45c tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:59.762958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:59.765460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:59.765460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:59.765770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] PATH_INFO: `/v3/projects/f37c199b1ec7405a8b5bbc3fc1646c8d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:59.767153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37c199b1ec7405a8b5bbc3fc1646c8d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:59.769384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:29:59.844719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37c199b1ec7405a8b5bbc3fc1646c8d', 'request_id': 'req-e82bc01d-95b4-400f-85f6-a45d313789b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.856263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37c199b1ec7405a8b5bbc3fc1646c8d', 'request_id': 'req-e82bc01d-95b4-400f-85f6-a45d313789b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.866783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37c199b1ec7405a8b5bbc3fc1646c8d', 'request_id': 'req-e82bc01d-95b4-400f-85f6-a45d313789b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.881771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] The token cache is being invalidate because project f37c199b1ec7405a8b5bbc3fc1646c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:29:59.882109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.882789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:29:59.888058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 902/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:29:59 2022] DELETE /identity/v3/projects/f37c199b1ec7405a8b5bbc3fc1646c8d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:29:59.889643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.891777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:59.910551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398bbb3-6452-4835-8a4e-35095ef78333 tempest-VolumeQuotaClassesTest-1623269438 tempest-VolumeQuotaClassesTest-1623269438-project-admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:29:59.922629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:29:59.925457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:29:59.986543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:29:59.987249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:29:59.987531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:29:59.987808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] PATH_INFO: `/v3/users/cc8c0cbf5cd343398e0811b24a511dc4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:29:59.989850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8c0cbf5cd343398e0811b24a511dc4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:29:59.991794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:00.005928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bc01d-95b4-400f-85f6-a45d313789b9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:00.012905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:00.015190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:00.015562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:00.015841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] PATH_INFO: `/v3/users/8b427f7d40fc4386b2b712f4c331ca82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:00.017102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b427f7d40fc4386b2b712f4c331ca82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:00.019378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:00.060248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:00.081295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8c0cbf5cd343398e0811b24a511dc4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.088731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b427f7d40fc4386b2b712f4c331ca82'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.091870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8c0cbf5cd343398e0811b24a511dc4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.093109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8c0cbf5cd343398e0811b24a511dc4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.096585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:00.100366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b427f7d40fc4386b2b712f4c331ca82'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.101540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b427f7d40fc4386b2b712f4c331ca82'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.103973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8c0cbf5cd343398e0811b24a511dc4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.117305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b427f7d40fc4386b2b712f4c331ca82'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.127412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6562ee63-c7c5-4c27-a4c1-9110025f24e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8c0cbf5cd343398e0811b24a511dc4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.137355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 884/1786] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:59 2022] DELETE /identity/v3/users/cc8c0cbf5cd343398e0811b24a511dc4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:00.162516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b427f7d40fc4386b2b712f4c331ca82'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:00.179161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 903/1787] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:29:59 2022] DELETE /identity/v3/users/8b427f7d40fc4386b2b712f4c331ca82 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:00.183791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:00.184132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:00.184414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:00.241698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:00.243429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:00.338394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 885/1788] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:00.362188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:00.365060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:00.480590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3e82c-cb10-4464-9456-b70e9a15ab2a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:00.503259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:00.503890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:00.504195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:00.504474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:00.536563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:00.538023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:00.557981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 904/1789] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:01.093378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.095312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.129210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e273f4-24c2-4a3a-b08e-759acfd7d220 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.135719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.136426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.136699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.136972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] PATH_INFO: `/v3/projects/744c29f078824e0d9f57728f0a3eab62` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.138662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744c29f078824e0d9f57728f0a3eab62)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:01.140661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:01.223121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744c29f078824e0d9f57728f0a3eab62', 'request_id': 'req-92739ea9-cee1-4129-b6a6-a146388697c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.235227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744c29f078824e0d9f57728f0a3eab62', 'request_id': 'req-92739ea9-cee1-4129-b6a6-a146388697c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.242057 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744c29f078824e0d9f57728f0a3eab62', 'request_id': 'req-92739ea9-cee1-4129-b6a6-a146388697c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.256576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.258247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.267312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] The token cache is being invalidate because project 744c29f078824e0d9f57728f0a3eab62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:01.268045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.269988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-92739ea9-cee1-4129-b6a6-a146388697c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.273149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 886/1790] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:01 2022] DELETE /identity/v3/projects/744c29f078824e0d9f57728f0a3eab62 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:01.278716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8bef-6092-4ca0-899b-54c0925b4751 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.280738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8bef-6092-4ca0-899b-54c0925b4751 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.282200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0166e4-779f-4a6c-91d4-93db0d217dfb service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.282860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8bef-6092-4ca0-899b-54c0925b4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.318822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d9ae8bef-6092-4ca0-899b-54c0925b4751 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:01.320358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d9ae8bef-6092-4ca0-899b-54c0925b4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.388572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.389525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.390039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.390320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] PATH_INFO: `/v3/projects/902db5dc5d8c476aa3b692c5c8233891` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.391700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902db5dc5d8c476aa3b692c5c8233891)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:01.394649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:01.397162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:01.417580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 887/1791] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:01.419549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.421000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.421476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.445131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:01.461936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.485318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902db5dc5d8c476aa3b692c5c8233891', 'request_id': 'req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.488191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:01.520360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902db5dc5d8c476aa3b692c5c8233891', 'request_id': 'req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.541945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902db5dc5d8c476aa3b692c5c8233891', 'request_id': 'req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.558268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] The token cache is being invalidate because project 902db5dc5d8c476aa3b692c5c8233891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:01.558650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.559613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.562295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 905/1792] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:01 2022] DELETE /identity/v3/projects/902db5dc5d8c476aa3b692c5c8233891 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:01.566739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.569159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.580090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 888/1793] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:01.582963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fbc9c-408f-4e79-a0f0-cc7ca2694245 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.584215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.590021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.590755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.591213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.591553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] PATH_INFO: `/v3/users/01ad0a016d7049a8850ac2ef7127f64b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.593599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ad0a016d7049a8850ac2ef7127f64b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:01.595583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd533-69c4-4815-9278-22ade1600de5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.595703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:01.601840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.603842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.604397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.604853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.605693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:01.606176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:01.608728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:01.625919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 889/1794] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:01.630079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.642376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417f71-2f1c-423d-af6f-62ab7b4288c1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.649267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.650143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.650571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.650877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.651591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:01.653696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:01.676068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ad0a016d7049a8850ac2ef7127f64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.688025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ad0a016d7049a8850ac2ef7127f64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.688858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ad0a016d7049a8850ac2ef7127f64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.698086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 890/1795] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:01 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:01.699393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.701090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ad0a016d7049a8850ac2ef7127f64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.701464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.726348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ad0a016d7049a8850ac2ef7127f64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:01.737525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 906/1796] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:01 2022] DELETE /identity/v3/users/01ad0a016d7049a8850ac2ef7127f64b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:01.788724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c7449-e61c-4ba9-af52-c87dfaeacd02 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.827473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:01.829064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.917029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.918260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.918556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.918858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.919533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:01.925659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:01.949335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbfddb-2a2c-4e08-9781-d1d27c6a5992 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:01.955613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:01.956760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:01.957068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:01.957378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:01.959693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:01.971272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:01.987736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 891/1797] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:01 2022] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:01.989294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.004365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677b00a-427e-419b-be62-23e699294010 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.010126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.010866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.011217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.011569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.012550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.014291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.038755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 892/1798] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:02.043606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.063337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda69276-cf6d-42bd-b8f7-c780466f3fb1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.068518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.069799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.070153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.070502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.071219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.073010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.085483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 893/1799] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:02.090142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.111196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0c8d8-9f61-48ee-b205-f3ddfeb21296 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.114728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.116659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ce8a3-8ecb-4139-9c4f-2bf75436e2f9 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.122288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.124215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:02.124601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.125780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.125780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] PATH_INFO: `/v3/projects/960b65d1879e46aaa19bcab7fc5e7ce0/users/310a4f6416874edaac516d617d669a12/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.133221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 907/1800] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:02.159463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960b65d1879e46aaa19bcab7fc5e7ce0, user_id=310a4f6416874edaac516d617d669a12, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.162389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.195071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 894/1801] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:02 2022] PUT /identity/v3/projects/960b65d1879e46aaa19bcab7fc5e7ce0/users/310a4f6416874edaac516d617d669a12/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:02.203889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.204206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.204488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.244116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] MFA Rules not processed for user `310a4f6416874edaac516d617d669a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:02.245760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:02.415732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.418723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:02.438209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 908/1802] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:02.439275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.523971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982210-0374-4200-9855-898a9a3af2c1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.532990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.534131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.534524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.534849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] PATH_INFO: `/v3/projects/c91ba3605174418bae1c9748b876d293` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.536728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91ba3605174418bae1c9748b876d293)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.539350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.612856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e892ce-764a-4ddb-86c7-0fefca72b927 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.622255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91ba3605174418bae1c9748b876d293', 'request_id': 'req-728871b2-098f-4899-84db-f9dafc4713ce'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:02.633020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91ba3605174418bae1c9748b876d293', 'request_id': 'req-728871b2-098f-4899-84db-f9dafc4713ce'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:02.640304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91ba3605174418bae1c9748b876d293', 'request_id': 'req-728871b2-098f-4899-84db-f9dafc4713ce'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:02.655313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] The token cache is being invalidate because project c91ba3605174418bae1c9748b876d293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:02.655519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:02.656680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-728871b2-098f-4899-84db-f9dafc4713ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:02.658313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 895/1803] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:02 2022] DELETE /identity/v3/projects/c91ba3605174418bae1c9748b876d293 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:02.663791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c8cc-ea9e-47c8-b56a-9e94b1d9dbf4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.664281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c8cc-ea9e-47c8-b56a-9e94b1d9dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.664666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8c8cc-ea9e-47c8-b56a-9e94b1d9dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.695261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-59d8c8cc-ea9e-47c8-b56a-9e94b1d9dbf4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:02.697342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-59d8c8cc-ea9e-47c8-b56a-9e94b1d9dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:02.715731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.716414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.716695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.717660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.718669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.720347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.750179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:02.769913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 909/1804] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:02 2022] POST /identity/v3/projects => generated 373 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:02.774333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.776021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 896/1805] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:02.780621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:02.784473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.784874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.785255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.811350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:02.812879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:02.829767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:02.900566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 897/1806] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:02.905216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.913690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca161f-79d7-4522-8dfe-da4ae57f7647 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.926999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.928342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.928811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.929914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.931018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.933857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.940434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e189330-275b-4fbc-b75a-47dfcd836e3b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:02.954517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:02.957412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:02.958877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:02.959153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:02.959840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:02.961289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:02.962943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:02.977753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 910/1807] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:02 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:02.982254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:02.996166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 898/1808] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:02.999233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.004077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cd7bb-3ef1-4629-86c6-5f866853d74e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.010391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.011103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.012186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.012485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.013152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.015045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b304-9145-4718-a6a3-e0b441edde51 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.016007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.020690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.021449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.021798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.022134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.022853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.025528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.032389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 911/1809] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:03.036879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.051358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4927e-482b-4791-8776-3995ebbc1e6b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.057667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.059213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.059521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.059789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] PATH_INFO: `/v3/projects/e613ae3e266b48a5983a31fabaea7b94/users/cf58032c47e74665b4b37b56f7d79fe9/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.076337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 899/1810] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:02 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:03.077809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.080809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e613ae3e266b48a5983a31fabaea7b94, user_id=cf58032c47e74665b4b37b56f7d79fe9, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.084231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.103299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 912/1811] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:03 2022] PUT /identity/v3/projects/e613ae3e266b48a5983a31fabaea7b94/users/cf58032c47e74665b4b37b56f7d79fe9/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:03.104563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.163835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbf8ca-4b20-4fc5-b36c-70d76eef372f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.214436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917edf8-76c4-4baa-91d3-72d6df361eeb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.219329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.219957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.220234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.220502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.221144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.222741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.234513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 913/1812] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:03.238771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.245206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:03.251401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d3af6-ace9-4618-9bfa-64bc8d7fc43a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.254867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.255754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.256302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.256804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.257121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d3eab-a3e4-48e4-9159-351935ca970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.257868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3eab-a3e4-48e4-9159-351935ca970a admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.258057 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.258269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3eab-a3e4-48e4-9159-351935ca970a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.258602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3eab-a3e4-48e4-9159-351935ca970a admin admin] PATH_INFO: `/v3/projects/e613ae3e266b48a5983a31fabaea7b94/users/cf58032c47e74665b4b37b56f7d79fe9/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.260677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d3eab-a3e4-48e4-9159-351935ca970a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e613ae3e266b48a5983a31fabaea7b94, user_id=cf58032c47e74665b4b37b56f7d79fe9, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.261300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.263424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d3eab-a3e4-48e4-9159-351935ca970a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.275471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 914/1813] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:03 2022] PUT /identity/v3/projects/e613ae3e266b48a5983a31fabaea7b94/users/cf58032c47e74665b4b37b56f7d79fe9/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:03.286924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.287130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.287398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.303744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 900/1814] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:03 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:03.304591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.317693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdee6f-7525-4cfa-9bb7-bef3004b3cfc admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.326994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] MFA Rules not processed for user `cf58032c47e74665b4b37b56f7d79fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:03.328529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:03.405986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.407894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.408357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.408807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.410193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.412507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.430881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 901/1815] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:03.435115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.448962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914b329-28ef-46c6-9664-0942e574fb87 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.470194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.471090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.472398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.473582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.474413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.477653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:03.480472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.520895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 902/1816] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:03.521802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.540571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 915/1817] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:03.543114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510f5a-8df6-4866-93e2-db031730bb11 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.553410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.555282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:03.567490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80ae98-feac-4c73-b64f-11896e008960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.568354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80ae98-feac-4c73-b64f-11896e008960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.568736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80ae98-feac-4c73-b64f-11896e008960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.569168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80ae98-feac-4c73-b64f-11896e008960 admin admin] PATH_INFO: `/v3/projects/83214b60d033433bb8e52599ebe6fa08/users/08009a6075b24d268f034e0c640a1a04/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.606295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80ae98-feac-4c73-b64f-11896e008960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83214b60d033433bb8e52599ebe6fa08, user_id=08009a6075b24d268f034e0c640a1a04, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.614245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80ae98-feac-4c73-b64f-11896e008960 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.642148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 903/1818] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:03 2022] PUT /identity/v3/projects/83214b60d033433bb8e52599ebe6fa08/users/08009a6075b24d268f034e0c640a1a04/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:03.655189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.655607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.656724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.675023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8dd57-11be-43fd-82fc-9bbfc02c78dc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.703908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] MFA Rules not processed for user `08009a6075b24d268f034e0c640a1a04`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:03.705395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:03.805757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 904/1819] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:03.810145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:03.810917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.811555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.811838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.812137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.920986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:03.957268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f7f2c-743e-4d60-b6ca-567d56e47a76 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:03.965189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.965425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:03.966221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:03.966647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:03.967629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:03.968478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:03.968942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.972168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:03.992937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 916/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:04.030905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 905/1821] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:03 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:04.032296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.067791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d4078-e712-4dd0-8047-221a06089960 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.250456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:04.258509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:04.260106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.260964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.261408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.262215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:04.265327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:04.302232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 917/1822] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:04 2022] POST /identity/v3/users => generated 300 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:04.307722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.322949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85c96d-1ffe-4719-978e-b2c5be469b2c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.335787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:04.336697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.337073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.337493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.338246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:04.343611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:04.367601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 906/1823] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:04.371815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.387025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebce1-e664-4d77-bbc1-a506170859b7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.393238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:04.394112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.394553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.394921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] PATH_INFO: `/v3/projects/84ff00a56260432389968bd523582803/users/46705de3d54f448483f8dfc5bff56a3d/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.419193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ff00a56260432389968bd523582803, user_id=46705de3d54f448483f8dfc5bff56a3d, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:04.423302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:04.448985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 918/1824] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:04 2022] PUT /identity/v3/projects/84ff00a56260432389968bd523582803/users/46705de3d54f448483f8dfc5bff56a3d/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:04.452285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.475736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cd90a-f8c0-4a27-a1df-b3e66b5239fd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.565832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912ff84-6a07-4ad9-bc7a-1edc4f895589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:04.566850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ff84-6a07-4ad9-bc7a-1edc4f895589 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.567193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ff84-6a07-4ad9-bc7a-1edc4f895589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.567851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ff84-6a07-4ad9-bc7a-1edc4f895589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.568653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912ff84-6a07-4ad9-bc7a-1edc4f895589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:04.569961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912ff84-6a07-4ad9-bc7a-1edc4f895589 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:04.584156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 907/1825] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:04.588833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.608141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9414dc0-e8a9-4e47-be4d-622d6054a3d4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.616816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:04.617460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.617830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.618846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] PATH_INFO: `/v3/projects/84ff00a56260432389968bd523582803/users/46705de3d54f448483f8dfc5bff56a3d/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.621980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ff00a56260432389968bd523582803, user_id=46705de3d54f448483f8dfc5bff56a3d, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:04.626132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:04.651072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 919/1826] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:04 2022] PUT /identity/v3/projects/84ff00a56260432389968bd523582803/users/46705de3d54f448483f8dfc5bff56a3d/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:04.661924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.662629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.662906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.706477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.733055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] MFA Rules not processed for user `46705de3d54f448483f8dfc5bff56a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:04.736178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:04.793997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639b4b-61b0-47ec-9896-195b0feea2e5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.800035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:04.800689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.800967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.801240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] PATH_INFO: `/v3/users/310a4f6416874edaac516d617d669a12` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.802412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=310a4f6416874edaac516d617d669a12)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:04.804788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:04.848768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 908/1827] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:04.860966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:04.863336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:04.873826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310a4f6416874edaac516d617d669a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:04.885165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310a4f6416874edaac516d617d669a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:04.885954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310a4f6416874edaac516d617d669a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:04.896806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310a4f6416874edaac516d617d669a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:04.923473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-18a5201d-abad-43c2-aece-0da45dc3a9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310a4f6416874edaac516d617d669a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:04.923660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:04.939348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 920/1828] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:04 2022] DELETE /identity/v3/users/310a4f6416874edaac516d617d669a12 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:04.946487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:04.947050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:04.947570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:04.948880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f34f0b-db0a-4ba7-ae8a-0e1de8fd2fc0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:04.974007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:04.975517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:05.017441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:05.018691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:05.019325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:05.019594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:05.020308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:05.022397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:05.069946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 921/1829] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:05.080613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:05.082805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:05.100718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:05.102916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:05.116578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 909/1830] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:05.158648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680b06d-396b-430c-8e47-f6fc18bfddde None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:05.163079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c672987-37f3-4f02-abcb-d796ee3c4bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:05.163707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c672987-37f3-4f02-abcb-d796ee3c4bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:05.164029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c672987-37f3-4f02-abcb-d796ee3c4bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:05.164292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c672987-37f3-4f02-abcb-d796ee3c4bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:05.175615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c672987-37f3-4f02-abcb-d796ee3c4bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:05.177101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c672987-37f3-4f02-abcb-d796ee3c4bc0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:05.190720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 922/1831] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:05.581840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:05.583777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:05.622778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d53696-f52f-46e3-b35f-4b47ea771190 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:05.632636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:05.638445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:05.640653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:05.640978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] PATH_INFO: `/v3/users/08009a6075b24d268f034e0c640a1a04` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:05.644414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] RBAC: Authorizing `identity:delete_user(user_id=08009a6075b24d268f034e0c640a1a04)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:05.646766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:05.743408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08009a6075b24d268f034e0c640a1a04'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:05.758056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08009a6075b24d268f034e0c640a1a04'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:05.759468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08009a6075b24d268f034e0c640a1a04'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:05.772060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08009a6075b24d268f034e0c640a1a04'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:05.791074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08009a6075b24d268f034e0c640a1a04'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:05.800230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 910/1832] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:05 2022] DELETE /identity/v3/users/08009a6075b24d268f034e0c640a1a04 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:05.806211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:05.806657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:05.806946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:05.830319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:05.831578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:05.908661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 923/1833] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:05.920651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:05.922301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:05.942373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:06.030214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575654-49cf-40af-b812-8629c46b05df admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:06.035165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:06.036880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:06.037610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:06.038114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:06.051590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:06.053067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:06.066663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 911/1834] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:06.499245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:06.501243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:06.552048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2d835-50d1-4a1b-b917-19ff1eaa3e1f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:06.575114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:06.577407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:06.578094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:06.578632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] PATH_INFO: `/v3/projects/83214b60d033433bb8e52599ebe6fa08` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:06.581075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83214b60d033433bb8e52599ebe6fa08)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:06.584689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:06.639979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83214b60d033433bb8e52599ebe6fa08', 'request_id': 'req-6909b474-f36b-4270-9c0c-7ae150f38ce2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.649929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83214b60d033433bb8e52599ebe6fa08', 'request_id': 'req-6909b474-f36b-4270-9c0c-7ae150f38ce2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.657705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:06.660032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83214b60d033433bb8e52599ebe6fa08', 'request_id': 'req-6909b474-f36b-4270-9c0c-7ae150f38ce2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.673741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] The token cache is being invalidate because project 83214b60d033433bb8e52599ebe6fa08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:06.674416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.675290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.681458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:06.684009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 924/1835] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:06 2022] DELETE /identity/v3/projects/83214b60d033433bb8e52599ebe6fa08 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:06.693367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb37803-6669-4abe-8d02-df20fb954588 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:06.753109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:06.755603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:06.812736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:06.813517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:06.813869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:06.814883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] PATH_INFO: `/v3/users/46705de3d54f448483f8dfc5bff56a3d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:06.816460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46705de3d54f448483f8dfc5bff56a3d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:06.818883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:06.898044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909b474-f36b-4270-9c0c-7ae150f38ce2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:06.904283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:06.905081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:06.905369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:06.905652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] PATH_INFO: `/v3/projects/960b65d1879e46aaa19bcab7fc5e7ce0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:06.906961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960b65d1879e46aaa19bcab7fc5e7ce0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:06.908748 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46705de3d54f448483f8dfc5bff56a3d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.909367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:06.921900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46705de3d54f448483f8dfc5bff56a3d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.924518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46705de3d54f448483f8dfc5bff56a3d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.935497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46705de3d54f448483f8dfc5bff56a3d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.953313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46705de3d54f448483f8dfc5bff56a3d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.961372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 912/1836] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:06 2022] DELETE /identity/v3/users/46705de3d54f448483f8dfc5bff56a3d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:06.981959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960b65d1879e46aaa19bcab7fc5e7ce0', 'request_id': 'req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:06.994715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960b65d1879e46aaa19bcab7fc5e7ce0', 'request_id': 'req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.002027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960b65d1879e46aaa19bcab7fc5e7ce0', 'request_id': 'req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.025162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] The token cache is being invalidate because project 960b65d1879e46aaa19bcab7fc5e7ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:07.025396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.026084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.027660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 925/1837] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:06 2022] DELETE /identity/v3/projects/960b65d1879e46aaa19bcab7fc5e7ce0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:07.031846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:07.033286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.071092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:07.103042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7deb-2147-47c3-b8cf-ee473188551a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:07.108319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:07.108962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.109241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.109668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] PATH_INFO: `/v3/users/cf58032c47e74665b4b37b56f7d79fe9` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.110825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf58032c47e74665b4b37b56f7d79fe9)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:07.112937 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:07.174488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf58032c47e74665b4b37b56f7d79fe9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.187471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf58032c47e74665b4b37b56f7d79fe9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.189685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf58032c47e74665b4b37b56f7d79fe9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.209666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf58032c47e74665b4b37b56f7d79fe9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.227828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf58032c47e74665b4b37b56f7d79fe9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.241572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 913/1838] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:07 2022] DELETE /identity/v3/users/cf58032c47e74665b4b37b56f7d79fe9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:07.306667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:07.309079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.406489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbcc34-f050-4c85-a1a9-a5c0355bd5e2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:07.440076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:07.513245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:07.513621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.514570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.514854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] PATH_INFO: `/v3/projects/84ff00a56260432389968bd523582803` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.516211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ff00a56260432389968bd523582803)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:07.518132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:07.588285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ff00a56260432389968bd523582803', 'request_id': 'req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.590655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:07.593219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.605414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ff00a56260432389968bd523582803', 'request_id': 'req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.640152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ff00a56260432389968bd523582803', 'request_id': 'req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.660096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] The token cache is being invalidate because project 84ff00a56260432389968bd523582803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:07.660321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.661693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb33ff-4a33-4150-a7e8-c32531afca59 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:07.663463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0fabe18f-26f2-4bc6-9982-8cd0c8ca6eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.665413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 926/1839] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:07 2022] DELETE /identity/v3/projects/84ff00a56260432389968bd523582803 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:07.670197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4c9bc-36e8-4622-af1e-403ae47ac66b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.670790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4c9bc-36e8-4622-af1e-403ae47ac66b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.671310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4c9bc-36e8-4622-af1e-403ae47ac66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.707144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2dc4c9bc-36e8-4622-af1e-403ae47ac66b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:07.708543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2dc4c9bc-36e8-4622-af1e-403ae47ac66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.792219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:07.793023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.793316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.793487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] PATH_INFO: `/v3/projects/e613ae3e266b48a5983a31fabaea7b94` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.794904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e613ae3e266b48a5983a31fabaea7b94)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:07.797445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:07.799991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 927/1840] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:07.805387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.805689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.805945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.833460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:07.834816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.844636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 928/1841] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:07.848830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:07.858275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7ff97-8429-4d00-9fbe-fe45cffe9ae1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:07.873588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e613ae3e266b48a5983a31fabaea7b94', 'request_id': 'req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.877665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:07.882955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e613ae3e266b48a5983a31fabaea7b94', 'request_id': 'req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.890282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e613ae3e266b48a5983a31fabaea7b94', 'request_id': 'req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.903872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] The token cache is being invalidate because project e613ae3e266b48a5983a31fabaea7b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:07.904257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.905725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8bc63e4e-bde4-4978-9db1-c4f8bdfd7176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:07.907437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 914/1842] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:07 2022] DELETE /identity/v3/projects/e613ae3e266b48a5983a31fabaea7b94 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:07.911228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:07.912407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0db3-c461-4ec7-b0a2-092cb08d4227 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.912594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0db3-c461-4ec7-b0a2-092cb08d4227 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.912829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0db3-c461-4ec7-b0a2-092cb08d4227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.924489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:07.925301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.925750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.926160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.927000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:07.927302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:07.928966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:07.933146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e33b0db3-c461-4ec7-b0a2-092cb08d4227 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:07.934565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e33b0db3-c461-4ec7-b0a2-092cb08d4227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.943071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 929/1843] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:07.945218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 915/1844] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:07.947743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:07.949502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.954830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.955119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.955387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.966652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4e41-9c9b-4925-afef-9071c432b7c0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:07.974380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:07.974998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:07.975274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:07.976491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:07.977150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:07.979348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:07.981769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:07.983020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:07.996707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 916/1845] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:08.003100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.016289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bad539-c382-4299-aa20-d5b1e4035a71 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.019983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 930/1846] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:08.024064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.028812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.029876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.030151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.030503 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.031250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:08.031608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.033334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.047607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 917/1847] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:08.051644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.081591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a9477-d576-493d-8a18-9273b39403af admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.151802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579db66f-d1ff-424c-ac71-9d6b8d281be6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.157631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.157793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.158379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.158673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.158798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.159082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.159188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.159504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.160187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.160715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.162103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.163651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.197217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 931/1848] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:08.201517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.219291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5791-230b-4010-bb8a-6abfd2d756da admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.228035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 918/1849] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:08.228182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.228313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.228597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.228869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.229422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.229550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.231107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.245298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 932/1850] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:08.249402 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.259858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c908e-5a35-4dec-8f6e-d6b3a5ab870c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.323679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12115ac5-af6e-49c6-ad63-f95278f9986f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.329843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.330652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.331780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.332176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.333220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.341921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.360543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 919/1851] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:08.365613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.372330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.372946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.373398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.373716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.374309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.375925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.376722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e845d-b3b9-4895-a732-e2be32228e6b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.384394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.385004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.385281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.385981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.386753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.391150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 933/1852] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:08.391329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.392081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.403441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 920/1853] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:08.404599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a223-437a-4666-bb55-7d8455036b31 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.405196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.409651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea79a1-f509-47da-8edb-970588af3ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.410319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea79a1-f509-47da-8edb-970588af3ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.410602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea79a1-f509-47da-8edb-970588af3ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.410863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea79a1-f509-47da-8edb-970588af3ef9 admin admin] PATH_INFO: `/v3/projects/a8769333411f476f81f243b3b99b6488/users/2b08c07f51c24a349cb42d41281fb1eb/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.416621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431651f5-11b4-46aa-a301-d27b2d30199e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.422104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.422850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.423366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.423641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.424446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.426020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.427491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea79a1-f509-47da-8edb-970588af3ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8769333411f476f81f243b3b99b6488, user_id=2b08c07f51c24a349cb42d41281fb1eb, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.430035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea79a1-f509-47da-8edb-970588af3ef9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.441944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 921/1854] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:08.443666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.447949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 934/1855] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:08 2022] PUT /identity/v3/projects/a8769333411f476f81f243b3b99b6488/users/2b08c07f51c24a349cb42d41281fb1eb/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:08.456356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286bc6-d6b2-4c2c-9bd5-17c8c9533593 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.460080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.460371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.460644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.466664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:08.488343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:08.493193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] MFA Rules not processed for user `2b08c07f51c24a349cb42d41281fb1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:08.495675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:08.526391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8e0e-3bd6-4d57-851e-42b2eeaa1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.526968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8e0e-3bd6-4d57-851e-42b2eeaa1866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.527245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8e0e-3bd6-4d57-851e-42b2eeaa1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.527571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8e0e-3bd6-4d57-851e-42b2eeaa1866 admin admin] PATH_INFO: `/v3/projects/7074bfb61b534549b7574eafe7770bc7/users/66a7cae74db64e219786f010b7ba22b9/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.545236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8e0e-3bd6-4d57-851e-42b2eeaa1866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7074bfb61b534549b7574eafe7770bc7, user_id=66a7cae74db64e219786f010b7ba22b9, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.548986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8e0e-3bd6-4d57-851e-42b2eeaa1866 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.564467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 922/1856] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:08 2022] PUT /identity/v3/projects/7074bfb61b534549b7574eafe7770bc7/users/66a7cae74db64e219786f010b7ba22b9/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:08.572090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 935/1857] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:08.580263 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.580615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.580956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.585795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.587222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:08.616313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] MFA Rules not processed for user `66a7cae74db64e219786f010b7ba22b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:08.618212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:08.649612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56431d33-4f73-4ed4-9e42-1b02af19e610 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.697703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 923/1858] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:08.704836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.705406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.706270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.706940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.707410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.777543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.779076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.780657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c88d04-9194-4610-b862-bc4d2364ffbd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.788209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.788878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.789224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.789538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.790464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.792851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.800046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 936/1859] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:08.814808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.826124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 924/1860] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:08.826284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b79a5e-536b-42b5-98d6-c6ebd4710527 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.830644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.841180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:08.841755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:08.898751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.899583 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.899869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.900186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] PATH_INFO: `/v3/users/2b08c07f51c24a349cb42d41281fb1eb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.901947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b08c07f51c24a349cb42d41281fb1eb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.903908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.906481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d4de-c9ec-46c3-9396-a4530584a905 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.917526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.918416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.918859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.919149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.920065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.921948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.947966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 925/1861] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:08 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:08.952346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.963013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb218bc4-0f4f-46a4-84b8-9644abb7ceac admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:08.964278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b08c07f51c24a349cb42d41281fb1eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:08.968482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:08.969095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:08.969414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:08.969727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:08.970362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:08.972130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:08.974345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b08c07f51c24a349cb42d41281fb1eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:08.975480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b08c07f51c24a349cb42d41281fb1eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:08.986453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 926/1862] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:08.986633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b08c07f51c24a349cb42d41281fb1eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:08.987460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:08.989272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.002811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-931997f8-d232-4e50-b116-496eef6f0730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b08c07f51c24a349cb42d41281fb1eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.002985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5b3c1-54e9-4a91-8b24-d6cd8a6ed0e8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.008687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.009354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.009635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.009897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 937/1863] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:08 2022] DELETE /identity/v3/users/2b08c07f51c24a349cb42d41281fb1eb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:09.012312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] PATH_INFO: `/v3/projects/6722ddd42b434a31b28c0cbbde13869d/users/30d9595ad32240298f53e939bcbd2baa/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.014587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.014946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.015291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.030922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6722ddd42b434a31b28c0cbbde13869d, user_id=30d9595ad32240298f53e939bcbd2baa, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.033565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.034621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:09.035818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.047021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 927/1864] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:08 2022] PUT /identity/v3/projects/6722ddd42b434a31b28c0cbbde13869d/users/30d9595ad32240298f53e939bcbd2baa/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:09.051036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.095784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 938/1865] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:09.105750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.107080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.113300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b70ed8-4b1d-42df-867d-f4d9d09c74bb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.119506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.120144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.120439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.120697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.121407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.122952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.133538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 928/1866] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:09.137550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.145805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:09.148358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fc57d-7f04-43a6-a102-70c8af4c3c1e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.154132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351eff9-9eef-4a02-9609-889dbb785e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.154838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351eff9-9eef-4a02-9609-889dbb785e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.155118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351eff9-9eef-4a02-9609-889dbb785e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.155520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351eff9-9eef-4a02-9609-889dbb785e53 admin admin] PATH_INFO: `/v3/projects/6722ddd42b434a31b28c0cbbde13869d/users/30d9595ad32240298f53e939bcbd2baa/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.157477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351eff9-9eef-4a02-9609-889dbb785e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6722ddd42b434a31b28c0cbbde13869d, user_id=30d9595ad32240298f53e939bcbd2baa, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.160113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351eff9-9eef-4a02-9609-889dbb785e53 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.169165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1509c0a-7a8a-498b-bfd0-76d6a709017f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.171355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 929/1867] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:09 2022] PUT /identity/v3/projects/6722ddd42b434a31b28c0cbbde13869d/users/30d9595ad32240298f53e939bcbd2baa/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:09.181698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.182289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.182567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.219795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.220490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.220765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.221039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.221154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] MFA Rules not processed for user `30d9595ad32240298f53e939bcbd2baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:09.222291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.260023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:09.293965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.296032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.303877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 930/1868] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:09.310172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 939/1869] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:09.316998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.318421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.393834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48815c5-92e5-4bcd-a7ec-d7e013b2d984 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.398265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.399390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.399698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.400040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.411006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.412491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.424408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 931/1870] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:09.526980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.539016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c6716-238b-41e5-a5a9-4edccb180b0a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.546835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.547416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.547699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.548009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] PATH_INFO: `/v3/users/66a7cae74db64e219786f010b7ba22b9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.549218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a7cae74db64e219786f010b7ba22b9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.551866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.614551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a7cae74db64e219786f010b7ba22b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.622718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a7cae74db64e219786f010b7ba22b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.623475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a7cae74db64e219786f010b7ba22b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.631462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a7cae74db64e219786f010b7ba22b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.642746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.644466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.646176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0992e772-590f-4022-bf07-ec2e9911ef9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a7cae74db64e219786f010b7ba22b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.652928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 940/1871] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:09 2022] DELETE /identity/v3/users/66a7cae74db64e219786f010b7ba22b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:09.657933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.658275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.658591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.660764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887f509-657f-4d64-bcdc-8d87f4f0b4a3 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.689273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:09.690539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.697096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:09.722587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.723229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.723507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.723782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] PATH_INFO: `/v3/projects/a8769333411f476f81f243b3b99b6488` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.725097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8769333411f476f81f243b3b99b6488)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.727117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.767972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 941/1872] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:09.776562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:09.778169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.786906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8769333411f476f81f243b3b99b6488', 'request_id': 'req-ce65b0a6-504f-434f-85a9-a5f349a505de'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.798167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8769333411f476f81f243b3b99b6488', 'request_id': 'req-ce65b0a6-504f-434f-85a9-a5f349a505de'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.804782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8769333411f476f81f243b3b99b6488', 'request_id': 'req-ce65b0a6-504f-434f-85a9-a5f349a505de'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.818008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] The token cache is being invalidate because project a8769333411f476f81f243b3b99b6488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:09.818306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.819072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ce65b0a6-504f-434f-85a9-a5f349a505de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:09.821128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 932/1873] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:09 2022] DELETE /identity/v3/projects/a8769333411f476f81f243b3b99b6488 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:09.832548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9fdc-dfff-4f0c-94bd-ee9b3f5a6d87 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.832833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9fdc-dfff-4f0c-94bd-ee9b3f5a6d87 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.833109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9fdc-dfff-4f0c-94bd-ee9b3f5a6d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.841921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:09.845785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c16e64-eb86-4698-bf97-686ba3ec0b81 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:09.865023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c36d9fdc-dfff-4f0c-94bd-ee9b3f5a6d87 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:09.866575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c36d9fdc-dfff-4f0c-94bd-ee9b3f5a6d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.902515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:09.903224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.903572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.904083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.906755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.937581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 933/1874] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:09.947750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:09.948098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:09.948333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:09.977878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:09.979431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:09.987536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 934/1875] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:09.989553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:09.991003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:09.992236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.001648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 942/1876] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:10.002946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae853-a863-4474-8d62-1c92d7e80377 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.008672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.009402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.009782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.010154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.010906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:10.011306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.013083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.035364 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 935/1877] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:10.037163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.062928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74c23-edaf-460f-b3cd-d84e30a1e3c8 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.068593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.069334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.069714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.070083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.070938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.073159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.093960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:10.111507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 943/1878] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:10 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:10.113116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.124838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2755d-c33f-4c39-a1a9-2b650e347ae1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.221989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.222619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.222898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.223197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.224342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.227646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.253878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 936/1879] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:10 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:10.258056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.268934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa46a3-09b6-4d4f-a81a-8ded7919d9ad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.275772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.276582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.276859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.277131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.277777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.279368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.290813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 944/1880] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:10.296396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.307017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce420a0a-d4b7-40f9-a60e-b49a20f30942 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.312727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.313402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.313695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.313956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.314627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.316243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.318275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.320114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:10.337883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 937/1881] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:10.338059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a08c-fc57-438b-bb9c-7eaf2d2ecf1e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.339010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.342678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.343497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.343987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.344811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] PATH_INFO: `/v3/projects/7074bfb61b534549b7574eafe7770bc7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.346115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7074bfb61b534549b7574eafe7770bc7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.348133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.350839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede797a-8993-43a3-820b-97b7ec2d216e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.355611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e035da-6890-4cff-8dcd-c9a282cdb94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.356299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e035da-6890-4cff-8dcd-c9a282cdb94d admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.356702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e035da-6890-4cff-8dcd-c9a282cdb94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.356980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e035da-6890-4cff-8dcd-c9a282cdb94d admin admin] PATH_INFO: `/v3/projects/10277d8078ff4abb8f4f31f626125200/users/8b567d4d9fce4a0e94ef443d3ba7a0e6/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.373078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e035da-6890-4cff-8dcd-c9a282cdb94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10277d8078ff4abb8f4f31f626125200, user_id=8b567d4d9fce4a0e94ef443d3ba7a0e6, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.376289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e035da-6890-4cff-8dcd-c9a282cdb94d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.390599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 938/1882] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:10 2022] PUT /identity/v3/projects/10277d8078ff4abb8f4f31f626125200/users/8b567d4d9fce4a0e94ef443d3ba7a0e6/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:10.395544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.395819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.396179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.399625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7074bfb61b534549b7574eafe7770bc7', 'request_id': 'req-8bca54ab-a035-428a-a255-e1ce7a9336a0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.409986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7074bfb61b534549b7574eafe7770bc7', 'request_id': 'req-8bca54ab-a035-428a-a255-e1ce7a9336a0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.415361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:10.415656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7074bfb61b534549b7574eafe7770bc7', 'request_id': 'req-8bca54ab-a035-428a-a255-e1ce7a9336a0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.416590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:10.428340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] The token cache is being invalidate because project 7074bfb61b534549b7574eafe7770bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:10.428630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.429278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.430776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 945/1883] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:10 2022] DELETE /identity/v3/projects/7074bfb61b534549b7574eafe7770bc7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:10.434562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.435848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:10.451251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:10.492434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 939/1884] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:10.499637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:10.501074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:10.504032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca54ab-a035-428a-a255-e1ce7a9336a0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.509974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.510840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.511558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.512012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] PATH_INFO: `/v3/users/30d9595ad32240298f53e939bcbd2baa` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.513463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d9595ad32240298f53e939bcbd2baa)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.515694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.567735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743cbd8-5b7c-4cab-a904-82add7e4fd36 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:10.571475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:10.572805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:10.573023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:10.573244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:10.583662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d9595ad32240298f53e939bcbd2baa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.585967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:10.587482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:10.597434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d9595ad32240298f53e939bcbd2baa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.598589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d9595ad32240298f53e939bcbd2baa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.600788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 940/1885] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:10.613804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d9595ad32240298f53e939bcbd2baa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.620158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:10.632472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5dd8df0c-a73d-474c-b395-5d4a8f67c24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d9595ad32240298f53e939bcbd2baa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:10.646270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 946/1886] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:10 2022] DELETE /identity/v3/users/30d9595ad32240298f53e939bcbd2baa => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:11.078204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.097238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7b03-9417-477a-87b1-66c906c7af33 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.227539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.228368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.228723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.229064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] PATH_INFO: `/v3/projects/6722ddd42b434a31b28c0cbbde13869d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.230436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6722ddd42b434a31b28c0cbbde13869d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.232820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.301022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6722ddd42b434a31b28c0cbbde13869d', 'request_id': 'req-aee36a5d-2b1e-4cc5-8000-afcce84a7047'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:11.312516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6722ddd42b434a31b28c0cbbde13869d', 'request_id': 'req-aee36a5d-2b1e-4cc5-8000-afcce84a7047'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:11.319269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6722ddd42b434a31b28c0cbbde13869d', 'request_id': 'req-aee36a5d-2b1e-4cc5-8000-afcce84a7047'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:11.349669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] The token cache is being invalidate because project 6722ddd42b434a31b28c0cbbde13869d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:11.349669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:11.350443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-aee36a5d-2b1e-4cc5-8000-afcce84a7047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:11.358623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 941/1887] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:11 2022] DELETE /identity/v3/projects/6722ddd42b434a31b28c0cbbde13869d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:11.363586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.364125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.364295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.387820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:11.389772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:11.476083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 947/1888] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:11.484337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.484689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.484978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.527370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:11.529534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:11.544295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 942/1889] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:11.547116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.562827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d5721-3028-4723-8839-dd05a62e478f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.569136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.569753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.570032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.570302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.571165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:11.571316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.573428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.592120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 948/1890] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:11.597052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.604700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:11.610167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b08b48-18d3-45ac-8f3d-dc57d50b1e42 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.620353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.621836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.622164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.622629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.623294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.625700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.687453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 943/1891] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:11 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:11.692188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.713988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d685-4d19-4650-a136-ff20f30c3aaf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.787731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.788635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.788978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.789324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.790086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.792168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.821856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 949/1892] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:11 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:11.823035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.835500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bc515-cc13-456e-ad42-520bfad3db7e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.843081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a41b38-40e3-44d6-abe1-cbf269f18765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.843777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41b38-40e3-44d6-abe1-cbf269f18765 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.844178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41b38-40e3-44d6-abe1-cbf269f18765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.844908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41b38-40e3-44d6-abe1-cbf269f18765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.845214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a41b38-40e3-44d6-abe1-cbf269f18765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.848434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a41b38-40e3-44d6-abe1-cbf269f18765 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.861136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 944/1893] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:11.866205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.879569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223028d-31f6-4462-b2e7-da4f38f04dc7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.895303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.896326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.896783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.897725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.897725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.898357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.899152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.899574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.902170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.922191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 950/1894] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:11.926679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:11.938492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911bf79-cb85-4b13-9251-983a7b58b2a1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:11.945128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d72c9-7377-493e-9c80-8636100f640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:11.945859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d72c9-7377-493e-9c80-8636100f640d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.946148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d72c9-7377-493e-9c80-8636100f640d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.946471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d72c9-7377-493e-9c80-8636100f640d admin admin] PATH_INFO: `/v3/projects/8f850bdc840b4dd795cf29705a91d8d3/users/8c67918036ec46c3a410fc8765b07b8d/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:11.954117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] MFA Rules not processed for user `8b567d4d9fce4a0e94ef443d3ba7a0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:11.955442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:11.964464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d72c9-7377-493e-9c80-8636100f640d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f850bdc840b4dd795cf29705a91d8d3, user_id=8c67918036ec46c3a410fc8765b07b8d, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:11.968052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d72c9-7377-493e-9c80-8636100f640d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:11.987265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 951/1895] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:11 2022] PUT /identity/v3/projects/8f850bdc840b4dd795cf29705a91d8d3/users/8c67918036ec46c3a410fc8765b07b8d/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:11.999306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:11.999591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:11.999865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.035067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] MFA Rules not processed for user `8c67918036ec46c3a410fc8765b07b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:12.036757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:12.038514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 945/1896] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:12.057678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.059088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:12.061890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:12.136297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 952/1897] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:12.137347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.160240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852eb9e-e5f2-45c1-ad75-a3c059ded991 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.238640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.239443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.239816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.240467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.276560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:12.297191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce63f1-4152-460c-8170-3dbb5435a7ad None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.307238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.308336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.308792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.309468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.312786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.314041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.314680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.317412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.327520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 946/1898] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:12.360010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 953/1899] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:12 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:12.370556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.383413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f3743-27bc-4d61-9a73-2d625ad6efbf service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.455768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.456627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.457035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.457313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.458226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.462283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.495449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 947/1900] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:12 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:12.496392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.507469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da642ee0-a988-416b-b069-2e982b9c2f77 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.513380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.515242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.515701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.516010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.517250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.519257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.535397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 954/1901] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:12.537237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.548968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39fa4c-95a7-43a9-83ee-667fc91e5efe admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.554291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70641f05-7f9d-49f6-a40e-61d42ff75912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.554954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70641f05-7f9d-49f6-a40e-61d42ff75912 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.555257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70641f05-7f9d-49f6-a40e-61d42ff75912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.555550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70641f05-7f9d-49f6-a40e-61d42ff75912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.556309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70641f05-7f9d-49f6-a40e-61d42ff75912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.557943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70641f05-7f9d-49f6-a40e-61d42ff75912 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.583286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 948/1902] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:12.584522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.594585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877462-8a92-45cd-bd97-829accf026f3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.599765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.600443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.600721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.600996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] PATH_INFO: `/v3/projects/34639dcaafed425ab66519f3e63eb694/users/bdfa9e6fac00435cac1695f92b023e1d/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.616206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34639dcaafed425ab66519f3e63eb694, user_id=bdfa9e6fac00435cac1695f92b023e1d, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.619256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.632382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 955/1903] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:12 2022] PUT /identity/v3/projects/34639dcaafed425ab66519f3e63eb694/users/bdfa9e6fac00435cac1695f92b023e1d/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:12.643550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.643839 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.644142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.685344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] MFA Rules not processed for user `bdfa9e6fac00435cac1695f92b023e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:12.687422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:12.784633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 949/1904] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:12.789277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.865701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539b7ef-5e82-48ef-8f73-acce6a4a18f0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.871350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:12.872072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:12.872363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:12.872638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:12.873360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:12.876376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:12.892922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:12.912230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 956/1905] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:12 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:12.916443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:12.930518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb0e01-a202-4464-ae07-ef31706862ee None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:12.984649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:13.015524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:13.016732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.016732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.017201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.018368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:13.021966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:13.062625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:13.063866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 950/1906] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:12 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:13.077471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbaf9a-a987-42b8-8054-7cec22119122 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:13.086618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:13.087423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.087824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.088403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.089181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:13.092032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:13.112778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 957/1907] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:13.114036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:13.127427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1bd3c-cf7c-477f-8089-eaafbec6dd6f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:13.132873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:13.133631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.133914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.134195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] PATH_INFO: `/v3/projects/b94eae864deb4c20b65db7787cb53f44/users/aef2a177fc4e46748c579829a537b0ae/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.152606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94eae864deb4c20b65db7787cb53f44, user_id=aef2a177fc4e46748c579829a537b0ae, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:13.156289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:13.190470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 951/1908] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:13 2022] PUT /identity/v3/projects/b94eae864deb4c20b65db7787cb53f44/users/aef2a177fc4e46748c579829a537b0ae/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:13.192971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:13.225133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c6a7-6d67-4dbd-9fca-2c6e044ef6e4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:13.321738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bdd90-6511-40da-bbf6-de184ec7b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:13.322709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bdd90-6511-40da-bbf6-de184ec7b550 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.323203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bdd90-6511-40da-bbf6-de184ec7b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.323723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bdd90-6511-40da-bbf6-de184ec7b550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.324635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bdd90-6511-40da-bbf6-de184ec7b550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:13.328029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bdd90-6511-40da-bbf6-de184ec7b550 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:13.347691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 958/1909] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:13.351797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:13.367862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f433a6-cc54-4a65-9ff6-e5cb6efa2276 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:13.375323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:13.376219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.378147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.378147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] PATH_INFO: `/v3/projects/b94eae864deb4c20b65db7787cb53f44/users/aef2a177fc4e46748c579829a537b0ae/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.379584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94eae864deb4c20b65db7787cb53f44, user_id=aef2a177fc4e46748c579829a537b0ae, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:13.387368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:13.399978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 952/1910] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:13 2022] PUT /identity/v3/projects/b94eae864deb4c20b65db7787cb53f44/users/aef2a177fc4e46748c579829a537b0ae/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:13.410261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9edc4-57f7-488c-967c-c87269433c10 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.410705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9edc4-57f7-488c-967c-c87269433c10 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.411074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9edc4-57f7-488c-967c-c87269433c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.444007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2ad9edc4-57f7-488c-967c-c87269433c10 None None] MFA Rules not processed for user `aef2a177fc4e46748c579829a537b0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:13.445037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2ad9edc4-57f7-488c-967c-c87269433c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:13.687164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 959/1911] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:13.744972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:13.843596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b4f40-c5f3-478d-8bdc-d277931eb6a0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:13.849342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:13.850318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:13.855324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:13.856047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:13.880162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:13.892906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:13.906106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 953/1912] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:14.003202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:14.003636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:14.004188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:14.027745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] MFA Rules not processed for user `8b567d4d9fce4a0e94ef443d3ba7a0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:14.029163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:14.107599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 960/1913] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:14.593147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:14.602709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b157-147d-411f-9330-0cc7fe45d30a service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:14.606821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9a68-71b2-41b1-b4a6-8f38bf059ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:14.608429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9a68-71b2-41b1-b4a6-8f38bf059ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:14.608914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9a68-71b2-41b1-b4a6-8f38bf059ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:14.609299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9a68-71b2-41b1-b4a6-8f38bf059ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:14.676142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9a68-71b2-41b1-b4a6-8f38bf059ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:14.688099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9a68-71b2-41b1-b4a6-8f38bf059ad0 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:14.704572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 954/1914] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:16.654408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:16.656522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:16.666770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:16.720863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bd5ce-21ba-4af2-b9d0-421c3a0b5f04 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:16.725388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:16.726015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:16.726296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:16.726570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] PATH_INFO: `/v3/users/d5f5a53f174c42dd86e0442e5f0a1c26` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:16.727687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f5a53f174c42dd86e0442e5f0a1c26)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:16.729640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:16.776178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f5a53f174c42dd86e0442e5f0a1c26'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:16.784042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f5a53f174c42dd86e0442e5f0a1c26'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:16.784652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f5a53f174c42dd86e0442e5f0a1c26'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:16.791536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f5a53f174c42dd86e0442e5f0a1c26'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:16.803462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f5a53f174c42dd86e0442e5f0a1c26'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:16.809409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 961/1915] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:16 2022] DELETE /identity/v3/users/d5f5a53f174c42dd86e0442e5f0a1c26 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:16.813885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:16.814422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:16.814422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:16.833239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:16.834433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:16.862438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:16.898656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 955/1916] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:16.909764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:16.911340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:16.973482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f4be-fcd9-40d3-80ad-86c9c284044f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:16.977811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:16.978438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:16.978720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:16.978995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:16.989934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:16.991375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:17.006530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 962/1917] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:17.609760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:17.611329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:17.664383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ea95c-1e0b-435b-b2c6-cf0f95057fcc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:17.679259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:17.681563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:17.681854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:17.682146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] PATH_INFO: `/v3/projects/2056238ccdf5449ebb00d1c8c0c71f5f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:17.687622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2056238ccdf5449ebb00d1c8c0c71f5f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:17.698216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:17.881804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2056238ccdf5449ebb00d1c8c0c71f5f', 'request_id': 'req-db272d49-ccf9-408d-96a7-91d45b9bab79'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:17.942227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2056238ccdf5449ebb00d1c8c0c71f5f', 'request_id': 'req-db272d49-ccf9-408d-96a7-91d45b9bab79'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:17.976515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2056238ccdf5449ebb00d1c8c0c71f5f', 'request_id': 'req-db272d49-ccf9-408d-96a7-91d45b9bab79'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.002998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] The token cache is being invalidate because project 2056238ccdf5449ebb00d1c8c0c71f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:18.003490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.004623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.006639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 956/1918] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:17 2022] DELETE /identity/v3/projects/2056238ccdf5449ebb00d1c8c0c71f5f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:18.014046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:18.027364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab7562-aa6a-4d4d-a54e-4bb90e822b40 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:18.090299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:18.131853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:18.132722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:18.133149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:18.133640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] PATH_INFO: `/v3/users/adc72a3816564c5a9b170f96629426de` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:18.135091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc72a3816564c5a9b170f96629426de)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:18.137526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:18.247973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc72a3816564c5a9b170f96629426de'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.266650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc72a3816564c5a9b170f96629426de'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.267520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc72a3816564c5a9b170f96629426de'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.279070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc72a3816564c5a9b170f96629426de'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.304876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cdd0caab-61b8-46c1-b7d5-6513be64a9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc72a3816564c5a9b170f96629426de'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:18.317497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 963/1919] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:18 2022] DELETE /identity/v3/users/adc72a3816564c5a9b170f96629426de => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:18.815515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:18.817554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:18.842302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db272d49-ccf9-408d-96a7-91d45b9bab79 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:18.956667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:18.958066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:18.958601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:18.958800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] PATH_INFO: `/v3/projects/ab244797e126453484eb8cdd7a9bcf39` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:18.960077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab244797e126453484eb8cdd7a9bcf39)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:18.962011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.049543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab244797e126453484eb8cdd7a9bcf39', 'request_id': 'req-e138ed2c-c8d2-4f2b-9e38-77427d721451'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:19.059078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab244797e126453484eb8cdd7a9bcf39', 'request_id': 'req-e138ed2c-c8d2-4f2b-9e38-77427d721451'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:19.063014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:19.067647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab244797e126453484eb8cdd7a9bcf39', 'request_id': 'req-e138ed2c-c8d2-4f2b-9e38-77427d721451'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:19.085017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] The token cache is being invalidate because project ab244797e126453484eb8cdd7a9bcf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:19.085532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:19.086349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e138ed2c-c8d2-4f2b-9e38-77427d721451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:19.088292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 957/1920] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:18 2022] DELETE /identity/v3/projects/ab244797e126453484eb8cdd7a9bcf39 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:19.093078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.093882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.095007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.119036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:19.120766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:19.207975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 964/1921] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:19.213310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.213684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.214095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.240559 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:19.242006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:19.243222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.245316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:19.256492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 958/1922] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:19.257520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.269778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad105d1-5181-44fe-ab0b-ecb93ec7abcb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.279103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.280419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.280719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.281009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.281652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:19.281982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.284718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.299031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 959/1923] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:19.304882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.316380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467c38-ef88-46f2-81d5-eed0f423ea52 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.328260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.328874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.329151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.329424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.330048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.331997 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.332445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316675-a3ea-4d65-a861-9602936fc83f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.336243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.336935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.337217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.337495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.339704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:19.345343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:19.361122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 960/1924] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:19.365348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.409493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.410929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.419789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 965/1925] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:19.435579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7deb5-13e7-4254-b5de-8725ab1a1511 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.441558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.442225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.442508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.442779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.443423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.445427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.470861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 961/1926] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:19.472000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.482669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f0a44-633f-4a26-9e36-4a1f05a19e18 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.488180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.488786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.489061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.489330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.489962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.492206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.503320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 966/1927] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:19.507063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.522746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b882c-a727-4540-9b85-3d7416e121c4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.529331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd82e1-897e-49f2-abd1-38af8be56965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.530604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd82e1-897e-49f2-abd1-38af8be56965 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.530862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd82e1-897e-49f2-abd1-38af8be56965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.531199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd82e1-897e-49f2-abd1-38af8be56965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.531978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd82e1-897e-49f2-abd1-38af8be56965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.533802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd82e1-897e-49f2-abd1-38af8be56965 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.548053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 962/1928] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:19.550799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.561978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c7f4b-14a0-43d9-9d6a-1e3f2f837b49 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.567411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.568237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.568645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.568976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] PATH_INFO: `/v3/projects/de47347249c644e7a45d5fac8123c298/users/c43bd85d2e8643068e9cdfd691abd452/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.595793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de47347249c644e7a45d5fac8123c298, user_id=c43bd85d2e8643068e9cdfd691abd452, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.600041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.628502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 967/1929] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:19 2022] PUT /identity/v3/projects/de47347249c644e7a45d5fac8123c298/users/c43bd85d2e8643068e9cdfd691abd452/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:19.633741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.634034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.634356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.665110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] MFA Rules not processed for user `c43bd85d2e8643068e9cdfd691abd452`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:19.666421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:19.763103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 963/1930] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:19.768194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.847450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717566b1-95c1-4dd0-b998-95037f661433 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.856178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:19.857447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:19.857911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:19.858333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:19.860546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:19.863544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:19.904345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 968/1931] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:19.906409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:19.939512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803c6e-f28e-43c1-afab-2535bdcb2405 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:19.954926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:20.011835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.012484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.012768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.013049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.024396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.027348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.070047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 964/1932] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:19 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:20.074160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.091997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537400-fa5b-40f8-b7f6-350add517673 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.101448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.102669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.102952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.103357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.105479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.108265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.130059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 969/1933] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:20.136098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.164425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f57f2c-6ec7-451a-a59e-58ada38e01dd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.179961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d71a29-dc37-467a-adaa-5decf0ecb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.180659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71a29-dc37-467a-adaa-5decf0ecb413 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.181340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71a29-dc37-467a-adaa-5decf0ecb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.181340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71a29-dc37-467a-adaa-5decf0ecb413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.182001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d71a29-dc37-467a-adaa-5decf0ecb413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.183596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d71a29-dc37-467a-adaa-5decf0ecb413 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.215143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 965/1934] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:20.216198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.231152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efeb16-d697-41e3-9962-0fbcb01755a9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.241026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.241708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.241991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.242265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] PATH_INFO: `/v3/projects/138c9b28caa64054b6ad5ee2b20a7f39/users/e81df9432fc548b685d33a537811901c/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.263203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138c9b28caa64054b6ad5ee2b20a7f39, user_id=e81df9432fc548b685d33a537811901c, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.268573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.289430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 970/1935] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:20 2022] PUT /identity/v3/projects/138c9b28caa64054b6ad5ee2b20a7f39/users/e81df9432fc548b685d33a537811901c/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:20.301165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.301444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.301719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.362305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] MFA Rules not processed for user `e81df9432fc548b685d33a537811901c`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:20.364820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:20.471857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 966/1936] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:20.478011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.499527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:20.543539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056f362-5c90-43dc-b489-d15d23e9b372 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.548320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.548924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.549201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.549468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.550098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.552024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.580879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 971/1937] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:20 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:20.587197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.601448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165ff7-9f65-4ba7-a62c-3831e7326dce None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.656620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.657222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.657498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.657774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.658391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.660344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.680440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 967/1938] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:20 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:20.684515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.697355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69e516-1a81-4371-b8bc-330c0f7ba5cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.702685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.703303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.703579 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.703869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.704528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.706101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.716841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 972/1939] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:20.720758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.731264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762a6f1-8941-4a0a-b49d-bc5ebfdf78a2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.735980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.736645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.736957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.737236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] PATH_INFO: `/v3/projects/8237597547624c35b186c65392f6d358/users/8d05fb6ac38a415cbc31fc4fa0f87fbb/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.746595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:20.755077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8237597547624c35b186c65392f6d358, user_id=8d05fb6ac38a415cbc31fc4fa0f87fbb, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.757782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.777404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 968/1940] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:20 2022] PUT /identity/v3/projects/8237597547624c35b186c65392f6d358/users/8d05fb6ac38a415cbc31fc4fa0f87fbb/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:20.778359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.791192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab36e-120b-4d3b-8269-cf64475152cc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.860190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9ed91-16f5-42e9-a954-dfb5bf730836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.860889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ed91-16f5-42e9-a954-dfb5bf730836 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.861176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ed91-16f5-42e9-a954-dfb5bf730836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.861564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ed91-16f5-42e9-a954-dfb5bf730836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.862302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9ed91-16f5-42e9-a954-dfb5bf730836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.863986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9ed91-16f5-42e9-a954-dfb5bf730836 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.877473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 973/1941] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:20.880384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:20.900656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad13e-63e8-4927-8214-d862bb357bbe admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:20.910194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:20.910892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.911175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.911452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] PATH_INFO: `/v3/projects/8237597547624c35b186c65392f6d358/users/8d05fb6ac38a415cbc31fc4fa0f87fbb/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.913477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8237597547624c35b186c65392f6d358, user_id=8d05fb6ac38a415cbc31fc4fa0f87fbb, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:20.916159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:20.927811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 969/1942] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:20 2022] PUT /identity/v3/projects/8237597547624c35b186c65392f6d358/users/8d05fb6ac38a415cbc31fc4fa0f87fbb/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:20.939225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:20.939712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:20.940215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:20.969187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] MFA Rules not processed for user `8d05fb6ac38a415cbc31fc4fa0f87fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:20.970389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:21.037087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 974/1943] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:21.048879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:21.104582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd56770-ec75-470a-8db6-1e3af220c6d0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:21.108886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:21.109581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:21.109866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:21.110140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:21.120539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:21.121345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:21.132601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 970/1944] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:21.174164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:21.175591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:21.188061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d9e3-73f1-43d0-92d0-b76f57e27cc2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:21.191633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b104ebb-f6fd-47b5-82a5-7c922adc5ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:21.192280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b104ebb-f6fd-47b5-82a5-7c922adc5ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:21.192559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b104ebb-f6fd-47b5-82a5-7c922adc5ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:21.192832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b104ebb-f6fd-47b5-82a5-7c922adc5ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:21.214288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:21.271500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b104ebb-f6fd-47b5-82a5-7c922adc5ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:21.272955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b104ebb-f6fd-47b5-82a5-7c922adc5ea7 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:21.281560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 975/1945] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:22.080423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:22.082907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:22.160832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d666d15-0ba5-45ae-8dc3-608e3a41a016 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:22.165721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:22.166478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:22.166856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:22.167227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] PATH_INFO: `/v3/users/8c67918036ec46c3a410fc8765b07b8d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:22.168492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c67918036ec46c3a410fc8765b07b8d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:22.170586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:22.255577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c67918036ec46c3a410fc8765b07b8d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:22.267780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c67918036ec46c3a410fc8765b07b8d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:22.268661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c67918036ec46c3a410fc8765b07b8d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:22.281280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c67918036ec46c3a410fc8765b07b8d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:22.297372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:22.299388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c67918036ec46c3a410fc8765b07b8d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:22.309912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 971/1946] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:22 2022] DELETE /identity/v3/users/8c67918036ec46c3a410fc8765b07b8d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:22.315622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:22.316173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:22.316275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:22.343536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:22.344995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:22.439547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 976/1947] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:22.469228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:22.470900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:22.639422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7472630-406b-4f4c-94af-806e3c942c77 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:22.653253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:22.654001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:22.654309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:22.654626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:22.668705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:22.670678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:22.682914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 972/1948] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:24.103241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:24.106327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:24.126049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd3b18-73bf-4fea-b220-5d14c4e69025 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:24.144174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:24.152445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:24.153341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:24.153341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] PATH_INFO: `/v3/projects/8f850bdc840b4dd795cf29705a91d8d3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:24.172183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f850bdc840b4dd795cf29705a91d8d3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:24.188879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:24.350010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f850bdc840b4dd795cf29705a91d8d3', 'request_id': 'req-19e06371-ad05-41c2-8cbf-2515384e1c42'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.366280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f850bdc840b4dd795cf29705a91d8d3', 'request_id': 'req-19e06371-ad05-41c2-8cbf-2515384e1c42'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.374808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f850bdc840b4dd795cf29705a91d8d3', 'request_id': 'req-19e06371-ad05-41c2-8cbf-2515384e1c42'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.390335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] The token cache is being invalidate because project 8f850bdc840b4dd795cf29705a91d8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:24.390711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.392511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.396966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 977/1949] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:24 2022] DELETE /identity/v3/projects/8f850bdc840b4dd795cf29705a91d8d3 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:24.398200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:24.408357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871623-358d-47dc-9404-8c8b13090a80 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:24.472920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:24.473735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:24.474226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:24.474514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] PATH_INFO: `/v3/users/bdfa9e6fac00435cac1695f92b023e1d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:24.476381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfa9e6fac00435cac1695f92b023e1d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:24.478550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:24.541140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfa9e6fac00435cac1695f92b023e1d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.552529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfa9e6fac00435cac1695f92b023e1d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.553434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfa9e6fac00435cac1695f92b023e1d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.564650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfa9e6fac00435cac1695f92b023e1d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.582976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1435c51a-2d58-4ba0-9949-c7d8fff8b5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfa9e6fac00435cac1695f92b023e1d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:24.590566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 973/1950] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:24 2022] DELETE /identity/v3/users/bdfa9e6fac00435cac1695f92b023e1d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:24.908249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:24.909728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:24.928046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e06371-ad05-41c2-8cbf-2515384e1c42 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:24.989375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:25.017085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:25.017085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:25.017085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:25.017469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] PATH_INFO: `/v3/users/c43bd85d2e8643068e9cdfd691abd452` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:25.018884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43bd85d2e8643068e9cdfd691abd452)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:25.021333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:25.095020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43bd85d2e8643068e9cdfd691abd452'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.113206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43bd85d2e8643068e9cdfd691abd452'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.113928 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43bd85d2e8643068e9cdfd691abd452'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.127114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43bd85d2e8643068e9cdfd691abd452'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.153945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43bd85d2e8643068e9cdfd691abd452'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.171269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:25.171869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:25.172374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:25.176048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 978/1951] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:24 2022] DELETE /identity/v3/users/c43bd85d2e8643068e9cdfd691abd452 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:25.203157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:25.204780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:25.221670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:25.284001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 974/1952] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:25.296545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:25.297892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:25.395690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc546be-2083-4c99-b35b-59a9a240f3a3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:25.402664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:25.403318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:25.403626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:25.404078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:25.420142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:25.424532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:25.441127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 979/1953] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:25.615064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:25.617186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:25.656389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37f6a-c33f-4b9f-9771-060406c8c187 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:25.670673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:25.671453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:25.671735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:25.672085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] PATH_INFO: `/v3/projects/34639dcaafed425ab66519f3e63eb694` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:25.684372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=34639dcaafed425ab66519f3e63eb694)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:25.687231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:25.802540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34639dcaafed425ab66519f3e63eb694', 'request_id': 'req-2303bc12-d698-4197-ad5c-3e8aa62581fe'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.819774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34639dcaafed425ab66519f3e63eb694', 'request_id': 'req-2303bc12-d698-4197-ad5c-3e8aa62581fe'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.829649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34639dcaafed425ab66519f3e63eb694', 'request_id': 'req-2303bc12-d698-4197-ad5c-3e8aa62581fe'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.859314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] The token cache is being invalidate because project 34639dcaafed425ab66519f3e63eb694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:25.859606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.864382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:25.866386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 975/1954] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:25 2022] DELETE /identity/v3/projects/34639dcaafed425ab66519f3e63eb694 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:25.870794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:25.881167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec9e0-3161-4732-bedc-9a76ad3fe704 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:25.953984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:25.956380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:25.956380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:25.956380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] PATH_INFO: `/v3/users/aef2a177fc4e46748c579829a537b0ae` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:25.956380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef2a177fc4e46748c579829a537b0ae)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:25.958252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:25.961279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:26.021148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef2a177fc4e46748c579829a537b0ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.031914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef2a177fc4e46748c579829a537b0ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.033089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef2a177fc4e46748c579829a537b0ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.049031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef2a177fc4e46748c579829a537b0ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.079552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:26.081024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:26.088728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef2a177fc4e46748c579829a537b0ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.100000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 980/1955] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:25 2022] DELETE /identity/v3/users/aef2a177fc4e46748c579829a537b0ae => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:26.121303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303bc12-d698-4197-ad5c-3e8aa62581fe admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:26.200567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:26.202177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.202498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.202774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] PATH_INFO: `/v3/projects/de47347249c644e7a45d5fac8123c298` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.204016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de47347249c644e7a45d5fac8123c298)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:26.205978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:26.266270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:26.272685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de47347249c644e7a45d5fac8123c298', 'request_id': 'req-cce14f81-9c0d-4290-bf39-7ea93938a7a0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.285982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de47347249c644e7a45d5fac8123c298', 'request_id': 'req-cce14f81-9c0d-4290-bf39-7ea93938a7a0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.296819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de47347249c644e7a45d5fac8123c298', 'request_id': 'req-cce14f81-9c0d-4290-bf39-7ea93938a7a0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.320451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] The token cache is being invalidate because project de47347249c644e7a45d5fac8123c298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:26.320747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.321435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.328892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 976/1956] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:26 2022] DELETE /identity/v3/projects/de47347249c644e7a45d5fac8123c298 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:26.329350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:26.330861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:26.347610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d1519-e029-487b-a724-0470c0fc0b24 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:26.433039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:26.433865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.434187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.434472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] PATH_INFO: `/v3/users/e81df9432fc548b685d33a537811901c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.435641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81df9432fc548b685d33a537811901c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:26.440457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:26.527801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81df9432fc548b685d33a537811901c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.540908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81df9432fc548b685d33a537811901c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.541121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81df9432fc548b685d33a537811901c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.552176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81df9432fc548b685d33a537811901c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.567658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:26.569381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:26.575547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-333543f1-87d3-4bea-a964-f0f850d1b1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81df9432fc548b685d33a537811901c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.578239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:26.587582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce14f81-9c0d-4290-bf39-7ea93938a7a0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:26.593659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:26.594430 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.594776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.595115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] PATH_INFO: `/v3/projects/b94eae864deb4c20b65db7787cb53f44` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.596564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94eae864deb4c20b65db7787cb53f44)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:26.597322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 981/1957] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:26 2022] DELETE /identity/v3/users/e81df9432fc548b685d33a537811901c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:26.598894 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:26.672720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94eae864deb4c20b65db7787cb53f44', 'request_id': 'req-de242e34-0102-4c18-8d47-08f423e8ab52'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.682265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94eae864deb4c20b65db7787cb53f44', 'request_id': 'req-de242e34-0102-4c18-8d47-08f423e8ab52'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.688476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94eae864deb4c20b65db7787cb53f44', 'request_id': 'req-de242e34-0102-4c18-8d47-08f423e8ab52'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.704342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] The token cache is being invalidate because project b94eae864deb4c20b65db7787cb53f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:26.704637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.705305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de242e34-0102-4c18-8d47-08f423e8ab52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:26.706830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 977/1958] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:26 2022] DELETE /identity/v3/projects/b94eae864deb4c20b65db7787cb53f44 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:26.713359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.713671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.714182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.744424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:26.745694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:26.840838 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 982/1959] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:26.844413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.844989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.845319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.872112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:26.873459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:26.883446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 978/1960] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:26.888792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:26.902724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752d0a2-b1d1-454a-b414-dc7e3ae961a5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:26.908810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:26.909442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.909722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.909997 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.910662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:26.910965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:26.913116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:26.929479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 983/1961] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:26.934339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:26.947575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e65c0-daa4-4b1a-bae1-f2d1682fb67d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:26.962123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:26.963257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:26.963772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:26.964498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:26.967830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:26.970787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.035274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 979/1962] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:26 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:27.061808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.082015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de3478-9d7d-4a5a-b283-67a2360168f5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:27.202320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:27.203031 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.203319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.203597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.204270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:27.207966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.241090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 984/1963] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:27 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:27.242434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.261169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028be5-95c6-4c16-8cdf-bf4d55eabffb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:27.276274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:27.276909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.277185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.277456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.278116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:27.280414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.300713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 980/1964] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:27.305067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.315984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297030-40b9-48d0-b1c8-aad5ca35aa7b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:27.323361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4c3bc-12fa-4865-96b0-19525976b60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:27.324020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4c3bc-12fa-4865-96b0-19525976b60c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.324396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4c3bc-12fa-4865-96b0-19525976b60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.324577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4c3bc-12fa-4865-96b0-19525976b60c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.325210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4c3bc-12fa-4865-96b0-19525976b60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:27.327470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4c3bc-12fa-4865-96b0-19525976b60c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.339709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 985/1965] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:27.345452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.359211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c281e59-c0c8-44a3-9db9-21e673461d61 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:27.366011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:27.366917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.367200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.367481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] PATH_INFO: `/v3/projects/10e28b8918ce4ebd8d0daf3fb9e11ed0/users/deea251296954b8c9574d60b0f0b45ef/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.387744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e28b8918ce4ebd8d0daf3fb9e11ed0, user_id=deea251296954b8c9574d60b0f0b45ef, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:27.396757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.454556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 981/1966] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:27 2022] PUT /identity/v3/projects/10e28b8918ce4ebd8d0daf3fb9e11ed0/users/deea251296954b8c9574d60b0f0b45ef/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:27.459410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.460050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.460396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.528075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] MFA Rules not processed for user `deea251296954b8c9574d60b0f0b45ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:27.529311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:27.648805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.654751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:27.671115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:27.689778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 986/1967] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:27.695109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.817475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:27.837338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20ee07-5645-4af5-b972-b387679b9077 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:27.850791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:27.851254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe805906-28c1-48cf-94e6-8036cebf535e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:27.859467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.859863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.860269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] PATH_INFO: `/v3/projects/138c9b28caa64054b6ad5ee2b20a7f39` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.861713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=138c9b28caa64054b6ad5ee2b20a7f39)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:27.864005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.873043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:27.873769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:27.874051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:27.874334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:27.875002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:27.877553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:27.925400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 987/1968] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:27 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:27.932379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:27.959960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138c9b28caa64054b6ad5ee2b20a7f39', 'request_id': 'req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:27.975113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138c9b28caa64054b6ad5ee2b20a7f39', 'request_id': 'req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:27.986275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138c9b28caa64054b6ad5ee2b20a7f39', 'request_id': 'req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.012211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] The token cache is being invalidate because project 138c9b28caa64054b6ad5ee2b20a7f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:28.012528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.013227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.015331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 982/1969] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:27 2022] DELETE /identity/v3/projects/138c9b28caa64054b6ad5ee2b20a7f39 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:28.020777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:28.023608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:28.068077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04f7a-372a-4be5-af00-69db414ad816 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.162057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.163011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.164023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.164736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.165451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.175178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.187054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41d1bd-a675-4ab4-a737-6e6be1a2c4fe admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.200359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.201039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.201747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.201747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] PATH_INFO: `/v3/users/8d05fb6ac38a415cbc31fc4fa0f87fbb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.206563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d05fb6ac38a415cbc31fc4fa0f87fbb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.208615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.229479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 988/1970] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:27 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:28.232707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:28.236415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:28.259894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938b77a-982c-4904-a5aa-6e233ae357db admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.278597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.280259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.280756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.281234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.282123 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.286204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.311673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 989/1971] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:28.316973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:28.330534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d05fb6ac38a415cbc31fc4fa0f87fbb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.335285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:28.343856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d05fb6ac38a415cbc31fc4fa0f87fbb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.344624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d05fb6ac38a415cbc31fc4fa0f87fbb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.350613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d37eac-e09e-4c54-8203-b6293fbdb010 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.362420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d05fb6ac38a415cbc31fc4fa0f87fbb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.373417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.374367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.374803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.375259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] PATH_INFO: `/v3/projects/6c4fa2a956274ac796eed60ffc78ad81/users/16f18c6d6e204e5f8b7f2682c1c94436/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.388732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d05fb6ac38a415cbc31fc4fa0f87fbb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:28.392815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:28.404415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 983/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:28 2022] DELETE /identity/v3/users/8d05fb6ac38a415cbc31fc4fa0f87fbb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:28.427907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4fa2a956274ac796eed60ffc78ad81, user_id=16f18c6d6e204e5f8b7f2682c1c94436, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.432165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.460181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 990/1973] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:28 2022] PUT /identity/v3/projects/6c4fa2a956274ac796eed60ffc78ad81/users/16f18c6d6e204e5f8b7f2682c1c94436/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:28.464222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:28.466136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:28.553878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3873dd-a710-421c-a397-fde3db8b086a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.624411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f87d7-e177-417b-a29a-25a820adc8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.624411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f87d7-e177-417b-a29a-25a820adc8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.624713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f87d7-e177-417b-a29a-25a820adc8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.624949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f87d7-e177-417b-a29a-25a820adc8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.625654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f87d7-e177-417b-a29a-25a820adc8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.627581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f87d7-e177-417b-a29a-25a820adc8d2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.643595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 984/1974] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:28.647594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:28.667670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd1cec-d9b5-4e45-bcdd-355706bdaf38 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.676355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.677180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.677361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.677623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] PATH_INFO: `/v3/projects/6c4fa2a956274ac796eed60ffc78ad81/users/16f18c6d6e204e5f8b7f2682c1c94436/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.679616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4fa2a956274ac796eed60ffc78ad81, user_id=16f18c6d6e204e5f8b7f2682c1c94436, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.684099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.697560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 991/1975] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:28 2022] PUT /identity/v3/projects/6c4fa2a956274ac796eed60ffc78ad81/users/16f18c6d6e204e5f8b7f2682c1c94436/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:28.709512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.709889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.710256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.745730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] MFA Rules not processed for user `16f18c6d6e204e5f8b7f2682c1c94436`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:28.747732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:28.838013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 985/1976] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:28.847983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:28.851620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:28.961504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050babea-1ff5-4457-a65e-1d78685b035f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:28.966651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:28.967839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:28.967839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:28.968080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:28.979330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:28.981023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:28.992836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 992/1977] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:29.648594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:29.650306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:29.709122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:29.710346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:29.774136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b74457-c597-48ea-8f4d-bebe801eb46d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:29.784307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:29.785768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:29.785768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:29.785768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] PATH_INFO: `/v3/projects/8237597547624c35b186c65392f6d358` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:29.786625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8237597547624c35b186c65392f6d358)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:29.788687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:29.821262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0c87-f425-457b-ad27-52d39a8e3004 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:29.827139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:29.827972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:29.828305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:29.828575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] PATH_INFO: `/v3/users/deea251296954b8c9574d60b0f0b45ef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:29.829788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deea251296954b8c9574d60b0f0b45ef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:29.832076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:29.849635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8237597547624c35b186c65392f6d358', 'request_id': 'req-d441b531-6423-4a52-b752-2ff31e32ff98'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.860731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8237597547624c35b186c65392f6d358', 'request_id': 'req-d441b531-6423-4a52-b752-2ff31e32ff98'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.870738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8237597547624c35b186c65392f6d358', 'request_id': 'req-d441b531-6423-4a52-b752-2ff31e32ff98'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.890113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] The token cache is being invalidate because project 8237597547624c35b186c65392f6d358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:29.890414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.891897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d441b531-6423-4a52-b752-2ff31e32ff98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.893451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 986/1978] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:29 2022] DELETE /identity/v3/projects/8237597547624c35b186c65392f6d358 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:29.900498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc543-b3fd-4c0b-9d12-3ad15bbdcf82 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:29.900860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc543-b3fd-4c0b-9d12-3ad15bbdcf82 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:29.901203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfc543-b3fd-4c0b-9d12-3ad15bbdcf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:29.913050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deea251296954b8c9574d60b0f0b45ef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.925068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-25dfc543-b3fd-4c0b-9d12-3ad15bbdcf82 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:29.926788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-25dfc543-b3fd-4c0b-9d12-3ad15bbdcf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:29.932820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deea251296954b8c9574d60b0f0b45ef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.933705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deea251296954b8c9574d60b0f0b45ef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.959636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deea251296954b8c9574d60b0f0b45ef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:29.982439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:29.996599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc7ff365-cf89-4bc4-8100-6190d064df58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deea251296954b8c9574d60b0f0b45ef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:30.018014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 993/1979] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:29 2022] DELETE /identity/v3/users/deea251296954b8c9574d60b0f0b45ef => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:30.019496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.019782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.020104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.057567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:30.060846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:30.126871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 987/1980] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:30.128977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.129338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.129684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.169712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:30.172718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:30.238382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 994/1981] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:30.254694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.257155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:30.289221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:30.308792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 988/1982] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:30.313178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.330675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e576495-d412-4bb7-b18d-90c1115738be None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.343382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.344053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.344337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.344612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.345278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:30.345585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.347265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.379517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 989/1983] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:30.380539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.396206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336e077-3874-46b6-846e-9a3b48ce89d7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.400954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf895-36c6-44a0-a803-8995f5d68f3d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.403530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.405096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.405920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.406406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.412931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.413576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.413855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.414129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.414779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.416792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.431383 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.435395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.448106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 995/1984] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:30.483546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 990/1985] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:30 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:30.488767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.505584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519f08-dc2e-499f-b976-9636516997d1 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.614468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.615312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.615595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.615869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.616561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.618625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.677415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 996/1986] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:30 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:30.681339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.698462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6396-e541-4dba-8d05-029dc78af23e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.710092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.710092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.710092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.710092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.712030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.717660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.749283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 991/1987] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:30.749414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.765562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff83bb-5fea-43ad-8d3c-60bc483f67a7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.787192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab351c-4a65-49d6-9032-3edb6a0979e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.787739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab351c-4a65-49d6-9032-3edb6a0979e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.788108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab351c-4a65-49d6-9032-3edb6a0979e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.788382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab351c-4a65-49d6-9032-3edb6a0979e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.789041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab351c-4a65-49d6-9032-3edb6a0979e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.790664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab351c-4a65-49d6-9032-3edb6a0979e1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.811752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 997/1988] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:30.816269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:30.839461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdcf8b-7382-4b9f-9737-5a3e71640cfd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:30.845717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:30.846970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.846970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.846970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] PATH_INFO: `/v3/projects/df6d2bc5ab66465eabcd3ddfaddf470a/users/d407354682cc45bfbf2cdddea3e2af72/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.865820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6d2bc5ab66465eabcd3ddfaddf470a, user_id=d407354682cc45bfbf2cdddea3e2af72, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:30.869619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:30.907886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 992/1989] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:30 2022] PUT /identity/v3/projects/df6d2bc5ab66465eabcd3ddfaddf470a/users/d407354682cc45bfbf2cdddea3e2af72/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:30.909714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:30.910002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:30.910331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:30.942173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:30.962650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] MFA Rules not processed for user `d407354682cc45bfbf2cdddea3e2af72`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:30.963866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:31.104749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 998/1990] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:31.108533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:31.253829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79299-14cf-4c5f-b36c-980982aa53c9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:31.271069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:31.272540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:31.274165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:31.274800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:31.275080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:31.275355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:31.276029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:31.277942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:31.300157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3d86-f8d5-431f-9111-73f0af9c2a97 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:31.317462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:31.318125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:31.318405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:31.318679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] PATH_INFO: `/v3/projects/10e28b8918ce4ebd8d0daf3fb9e11ed0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:31.320425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e28b8918ce4ebd8d0daf3fb9e11ed0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:31.322361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:31.362354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 993/1991] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:31 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:31.367448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:31.450933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e28b8918ce4ebd8d0daf3fb9e11ed0', 'request_id': 'req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:31.480346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e28b8918ce4ebd8d0daf3fb9e11ed0', 'request_id': 'req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:31.508097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e28b8918ce4ebd8d0daf3fb9e11ed0', 'request_id': 'req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:31.537789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] The token cache is being invalidate because project 10e28b8918ce4ebd8d0daf3fb9e11ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:31.538091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:31.543254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:31.547118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 999/1992] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:31 2022] DELETE /identity/v3/projects/10e28b8918ce4ebd8d0daf3fb9e11ed0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:31.560437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:31.566555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426411f-1d88-4b48-a7e5-a31ab66e0224 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:31.569193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:31.616765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:31.770254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:31.771143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:31.771569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:31.772168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:31.772954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:31.777840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:31.816083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f3e37-31b2-4ced-b269-94e2bd64c0b1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:31.857854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 994/1993] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:31 2022] POST /identity/v3/users => generated 296 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:31.857854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:31.858118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:31.861365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:31.861365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:31.861365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] PATH_INFO: `/v3/users/16f18c6d6e204e5f8b7f2682c1c94436` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:31.864035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:31.868753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f18c6d6e204e5f8b7f2682c1c94436)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:31.893617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:31.918444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c1f98-9ad2-4394-8a84-4277c9f3a1be admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:31.946070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:31.946301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:31.948560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:31.950160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:31.950532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:31.956606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:31.960845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:31.995155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 995/1994] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:31.996497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:32.021509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c7a0-fd6a-404e-b80b-2db741eab215 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:32.033923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:32.035963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:32.036322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f18c6d6e204e5f8b7f2682c1c94436'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:32.037629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:32.037933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] PATH_INFO: `/v3/projects/f732d50e7f4842c3a8ba1206826442ce/users/c7ae981ea7aa497595d0a3fced897a12/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:32.084282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f18c6d6e204e5f8b7f2682c1c94436'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:32.085052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f18c6d6e204e5f8b7f2682c1c94436'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:32.089266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f732d50e7f4842c3a8ba1206826442ce, user_id=c7ae981ea7aa497595d0a3fced897a12, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:32.095469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:32.104697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f18c6d6e204e5f8b7f2682c1c94436'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:32.134558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 996/1995] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:31 2022] PUT /identity/v3/projects/f732d50e7f4842c3a8ba1206826442ce/users/c7ae981ea7aa497595d0a3fced897a12/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:32.138217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:32.141931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:32.145173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f18c6d6e204e5f8b7f2682c1c94436'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:32.164452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1000/1996] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:31 2022] DELETE /identity/v3/users/16f18c6d6e204e5f8b7f2682c1c94436 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:32.290623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2daa9-e943-409b-9b97-4fb7e4e8ed85 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:32.491609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aacea3-d20d-41d8-a801-6638edf34903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:32.492864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aacea3-d20d-41d8-a801-6638edf34903 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:32.493540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aacea3-d20d-41d8-a801-6638edf34903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:32.494048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aacea3-d20d-41d8-a801-6638edf34903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:32.496063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aacea3-d20d-41d8-a801-6638edf34903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:32.499348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aacea3-d20d-41d8-a801-6638edf34903 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:32.521805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 997/1997] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:32.525672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:32.540122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252672fb-ea2e-467d-8ea4-63fff4718371 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:32.546119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:32.546932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:32.547319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:32.547664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] PATH_INFO: `/v3/projects/f732d50e7f4842c3a8ba1206826442ce/users/c7ae981ea7aa497595d0a3fced897a12/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:32.550140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f732d50e7f4842c3a8ba1206826442ce, user_id=c7ae981ea7aa497595d0a3fced897a12, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:32.553466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:32.569660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1001/1998] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:32 2022] PUT /identity/v3/projects/f732d50e7f4842c3a8ba1206826442ce/users/c7ae981ea7aa497595d0a3fced897a12/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:32.581162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:32.581460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:32.581728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:32.621764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] MFA Rules not processed for user `c7ae981ea7aa497595d0a3fced897a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:32.623107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:32.634227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:32.715981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 998/1999] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:32.725542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:32.728172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:32.808598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:32.810696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:32.836516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac1bc0-28bd-46d7-9771-61c8b8c9d7cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:32.842449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee9cf5-8427-457e-9425-f6db459755c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:32.843865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee9cf5-8427-457e-9425-f6db459755c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:32.844673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee9cf5-8427-457e-9425-f6db459755c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:32.845043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee9cf5-8427-457e-9425-f6db459755c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:32.869540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee9cf5-8427-457e-9425-f6db459755c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:32.871975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee9cf5-8427-457e-9425-f6db459755c2 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:32.896495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3f65d-0419-4e7d-9e4f-6e96e56b87c8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:32.900026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1002/2000] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:32.902407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:32.902995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:32.903388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:32.903768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] PATH_INFO: `/v3/projects/6c4fa2a956274ac796eed60ffc78ad81` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:32.907968 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4fa2a956274ac796eed60ffc78ad81)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:32.909893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.005368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4fa2a956274ac796eed60ffc78ad81', 'request_id': 'req-9a405a97-6587-45f1-a902-7aa439d85642'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.017209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4fa2a956274ac796eed60ffc78ad81', 'request_id': 'req-9a405a97-6587-45f1-a902-7aa439d85642'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.026985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4fa2a956274ac796eed60ffc78ad81', 'request_id': 'req-9a405a97-6587-45f1-a902-7aa439d85642'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.042716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] The token cache is being invalidate because project 6c4fa2a956274ac796eed60ffc78ad81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:33.043007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.043682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9a405a97-6587-45f1-a902-7aa439d85642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.046015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 999/2001] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:32 2022] DELETE /identity/v3/projects/6c4fa2a956274ac796eed60ffc78ad81 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:33.052826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.053106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.053375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.077702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:33.078978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.173519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1003/2002] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:33.181403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.181684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.181957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.211883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:33.213176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.226270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1000/2003] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:33.233548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.247009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087e0a3-fdc0-4f22-900f-26ffd1e0842c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.252425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.253160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.253534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.254070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.254830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:33.255216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.257149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.272760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1004/2004] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:33.277473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.289941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd225f6-06eb-45bf-bef5-bc45fcf80184 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.296279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.297028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.297379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.297747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.298468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.300674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.336164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1001/2005] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:33.337694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.351329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d88e6-a3bb-45d1-9f59-3c2936a99531 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.375894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:33.412192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.414366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.425501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:33.433426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.434047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.434354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.434627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.435269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.441547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.471062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1005/2006] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:33 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:33.475772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.490796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f954e-e8b0-43ac-b405-85c81b151abc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.497203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.497443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.497740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.498023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.498990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.500642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.503348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3aa5-352d-41a8-9c0d-139e22895aed admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.510821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.511551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.511901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.512931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] PATH_INFO: `/v3/users/d407354682cc45bfbf2cdddea3e2af72` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.516607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1006/2007] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:33.516734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d407354682cc45bfbf2cdddea3e2af72)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.517451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.520494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.531813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf367c-3852-4f90-82f0-93b15ee78748 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.547244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.548113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.548395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.548668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.549934 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.551556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.566987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1007/2008] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:33.571364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.583488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2e42-649f-478c-a06f-2e4ec5168992 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.589922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd407354682cc45bfbf2cdddea3e2af72'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.599028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd407354682cc45bfbf2cdddea3e2af72'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.599732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd407354682cc45bfbf2cdddea3e2af72'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.603385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38465a-15e2-48a0-9b81-cf7dba03f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.604700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38465a-15e2-48a0-9b81-cf7dba03f534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.604982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38465a-15e2-48a0-9b81-cf7dba03f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.605248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38465a-15e2-48a0-9b81-cf7dba03f534 admin admin] PATH_INFO: `/v3/projects/ce4978a987d84c3d8e7868a3d487c727/users/68f04e2750f04aecb3095fc2fc80f48f/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.609376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd407354682cc45bfbf2cdddea3e2af72'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.623394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38465a-15e2-48a0-9b81-cf7dba03f534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4978a987d84c3d8e7868a3d487c727, user_id=68f04e2750f04aecb3095fc2fc80f48f, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.626252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38465a-15e2-48a0-9b81-cf7dba03f534 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.630356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-754c17c4-4a17-4793-81a4-a045534bba99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd407354682cc45bfbf2cdddea3e2af72'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:33.637684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1002/2009] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:33 2022] DELETE /identity/v3/users/d407354682cc45bfbf2cdddea3e2af72 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:33.641740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.650840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.650996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1008/2010] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:33 2022] PUT /identity/v3/projects/ce4978a987d84c3d8e7868a3d487c727/users/68f04e2750f04aecb3095fc2fc80f48f/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:33.651096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.652701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0272-490b-44cd-9d6f-898573359afe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.653759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0272-490b-44cd-9d6f-898573359afe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.653759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0272-490b-44cd-9d6f-898573359afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.666288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:33.667782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.687693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-388f0272-490b-44cd-9d6f-898573359afe None None] MFA Rules not processed for user `68f04e2750f04aecb3095fc2fc80f48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:33.689328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-388f0272-490b-44cd-9d6f-898573359afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.737720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1003/2011] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:33.747515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.748966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.777489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1009/2012] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:33.786038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:33.790090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0272-490b-44cd-9d6f-898573359afe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:33.791497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-388f0272-490b-44cd-9d6f-898573359afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:33.818852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e2170-5cc3-4edd-996e-47c24cb0960d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.822719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.823401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.823598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.823875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.834387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.836069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.852852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1004/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:33.858136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0272-490b-44cd-9d6f-898573359afe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:33.863705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:33.864421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:33.865298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:33.865298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:33.873534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:33.883982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:33.885795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:33.915575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1010/2014] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:34.238917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:34.240617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:34.270961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeece8-a94a-48d1-840d-7904c3f08781 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:34.283626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:34.284616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:34.285142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:34.285711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] PATH_INFO: `/v3/projects/df6d2bc5ab66465eabcd3ddfaddf470a` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:34.288367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6d2bc5ab66465eabcd3ddfaddf470a)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:34.290867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:34.390797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6d2bc5ab66465eabcd3ddfaddf470a', 'request_id': 'req-7e6c91ac-d418-401c-b3df-95ae25e522f8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.407183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6d2bc5ab66465eabcd3ddfaddf470a', 'request_id': 'req-7e6c91ac-d418-401c-b3df-95ae25e522f8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.420313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6d2bc5ab66465eabcd3ddfaddf470a', 'request_id': 'req-7e6c91ac-d418-401c-b3df-95ae25e522f8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.441440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] The token cache is being invalidate because project df6d2bc5ab66465eabcd3ddfaddf470a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:34.442771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.443964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.447332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1005/2015] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:34 2022] DELETE /identity/v3/projects/df6d2bc5ab66465eabcd3ddfaddf470a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:34.451172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:34.467783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04df30-ea82-44ee-a64d-226e72efb095 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:34.571825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:34.572499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:34.572916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:34.573025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] PATH_INFO: `/v3/users/c7ae981ea7aa497595d0a3fced897a12` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:34.574141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ae981ea7aa497595d0a3fced897a12)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:34.576094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:34.652824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ae981ea7aa497595d0a3fced897a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.665924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ae981ea7aa497595d0a3fced897a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.666521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ae981ea7aa497595d0a3fced897a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.676634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ae981ea7aa497595d0a3fced897a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.692910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8321bf30-1235-454b-a3a9-753b882f2594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ae981ea7aa497595d0a3fced897a12'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:34.699259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1011/2016] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:34 2022] DELETE /identity/v3/users/c7ae981ea7aa497595d0a3fced897a12 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:35.103710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.105959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:35.125127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c91ac-d418-401c-b3df-95ae25e522f8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.217776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.218545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.218887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.219228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] PATH_INFO: `/v3/projects/f732d50e7f4842c3a8ba1206826442ce` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.220467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f732d50e7f4842c3a8ba1206826442ce)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.222982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.283374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f732d50e7f4842c3a8ba1206826442ce', 'request_id': 'req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:35.287135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:35.292476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f732d50e7f4842c3a8ba1206826442ce', 'request_id': 'req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:35.300494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f732d50e7f4842c3a8ba1206826442ce', 'request_id': 'req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:35.312164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] The token cache is being invalidate because project f732d50e7f4842c3a8ba1206826442ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:35.312458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:35.313096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3b7d72d6-131e-4004-8b49-f5b2c289d0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:35.314902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1006/2017] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:35 2022] DELETE /identity/v3/projects/f732d50e7f4842c3a8ba1206826442ce => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:35.320089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.320687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.320811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.340286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:35.341491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:35.406400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1012/2018] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:35.416651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.416651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.416651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.442981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:35.444546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:35.453499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1007/2019] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:35.457711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.478568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30185a22-ba62-40d8-b17a-e69eaac23abf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.484492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.485120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.485554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.485755 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.486318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:35.486624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.488240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.504977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1013/2020] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:35.509074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.519540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75904c-638a-4705-b0cc-d4205f8952cb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.524746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.525723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.526510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.526510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.527081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.529335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.575606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1008/2021] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:35 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:35.577328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.584333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:35.612183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbdc0c-97c8-4d33-9c5b-c113951c792f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.706349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.707137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.707306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.707592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.708311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.710281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.751699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1014/2022] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:35 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:35.753107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.764887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8641f-f6d7-4d71-85d4-83c36bfc7f4a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.769768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.770446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.770978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.771776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.772502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.774143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.787972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1009/2023] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:35.790992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.802249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb7cdb-05b4-4d86-b604-50827769dcfd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.808509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a06f7c-d7c7-4546-9ccd-115c8b803939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.809146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a06f7c-d7c7-4546-9ccd-115c8b803939 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.809396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a06f7c-d7c7-4546-9ccd-115c8b803939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.809663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a06f7c-d7c7-4546-9ccd-115c8b803939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.810306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a06f7c-d7c7-4546-9ccd-115c8b803939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.813163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a06f7c-d7c7-4546-9ccd-115c8b803939 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.824649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1015/2024] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:35.828934 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:35.838923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676523cf-80ed-4b12-9954-4f17e015f751 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:35.844573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:35.847197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.847197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.847197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] PATH_INFO: `/v3/projects/d3170c4fbf73405e9d90f27f3b4ba2e5/users/358bf1d94e414c92a8710c412ec4d6df/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.863971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3170c4fbf73405e9d90f27f3b4ba2e5, user_id=358bf1d94e414c92a8710c412ec4d6df, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:35.866873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:35.884798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1010/2025] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:35 2022] PUT /identity/v3/projects/d3170c4fbf73405e9d90f27f3b4ba2e5/users/358bf1d94e414c92a8710c412ec4d6df/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:35.895891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:35.896207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:35.896485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:35.932761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] MFA Rules not processed for user `358bf1d94e414c92a8710c412ec4d6df`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:35.936425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:36.040893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1016/2026] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:36.044987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.139742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4de82c-a43f-4853-8169-0a86de8dff6f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.145063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.145718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.147199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.147199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.147199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.149490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.188913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1011/2027] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:36.197112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.220257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad394a79-63b0-429b-9015-c330f568fd90 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.284292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.284918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.285219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.285489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.286132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.288155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.308379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:36.314988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1017/2028] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:36 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:36.319475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.330191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7d175-0bf9-4259-b1ba-3b5226b67212 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.335042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.335608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.335888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.336215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.336872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.338485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.350067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1012/2029] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:36.355072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.367902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aead7e6-2524-4eb9-86da-93c959c47a71 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.373284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38706aa-148a-4ef3-bc15-8a090c541c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.374477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38706aa-148a-4ef3-bc15-8a090c541c3a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.374757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38706aa-148a-4ef3-bc15-8a090c541c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.375025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38706aa-148a-4ef3-bc15-8a090c541c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.375814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38706aa-148a-4ef3-bc15-8a090c541c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.377563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38706aa-148a-4ef3-bc15-8a090c541c3a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.389085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1018/2030] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:36.394938 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.407231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488d9e5-b755-4e1c-9e7b-49fc1315086d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.411963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.412637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.412920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.413201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] PATH_INFO: `/v3/projects/52a26b8677b94b6c9be8d11a9dcca759/users/0ef11030e01c41fb9c61a9d5da211ff1/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.429533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a26b8677b94b6c9be8d11a9dcca759, user_id=0ef11030e01c41fb9c61a9d5da211ff1, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.432243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.445776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1013/2031] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:36 2022] PUT /identity/v3/projects/52a26b8677b94b6c9be8d11a9dcca759/users/0ef11030e01c41fb9c61a9d5da211ff1/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:36.456115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.456489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.456836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.491512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] MFA Rules not processed for user `0ef11030e01c41fb9c61a9d5da211ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:36.492705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:36.562444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1019/2032] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:36.567747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.609796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:36.652402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4e53-d401-4241-ad99-8cfe909f4650 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.658069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.658692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.658979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.659257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.659923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.661983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.694123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1014/2033] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:36.695621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.707127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e98d3-bd9a-439e-ae61-1a172d1cdd67 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.766632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.767265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.767540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.767810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.768478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.770369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.798807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1020/2034] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:36 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:36.802851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.814864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ae180-756d-481a-9238-a2a10d2463f5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.820302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.821026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.821404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.821775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.822578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.824323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.837631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1015/2035] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:36.842856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.856735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb12fa-c84c-4189-8b3c-19aaaebf3d5a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:36.860770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:36.860770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:36.861134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:36.861637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] PATH_INFO: `/v3/projects/6376415c34e9402795968fddb28f328d/users/01066839d29b43fa94eca2329ec5cc4f/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:36.883673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6376415c34e9402795968fddb28f328d, user_id=01066839d29b43fa94eca2329ec5cc4f, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:36.887017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:36.908037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1021/2036] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:36 2022] PUT /identity/v3/projects/6376415c34e9402795968fddb28f328d/users/01066839d29b43fa94eca2329ec5cc4f/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:36.910872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:36.922132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c285-f957-4c01-831e-128a4e473495 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:37.013134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d17dd-0120-4424-9362-bbac2fe46544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:37.014589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d17dd-0120-4424-9362-bbac2fe46544 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:37.014880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d17dd-0120-4424-9362-bbac2fe46544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:37.015214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d17dd-0120-4424-9362-bbac2fe46544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:37.015877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d17dd-0120-4424-9362-bbac2fe46544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:37.017761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d17dd-0120-4424-9362-bbac2fe46544 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:37.038279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:37.044056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1016/2037] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:37.054912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe6b12-3ffd-40cc-aed8-9137e9180749 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:37.064601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:37.065393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:37.065976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:37.066341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] PATH_INFO: `/v3/projects/6376415c34e9402795968fddb28f328d/users/01066839d29b43fa94eca2329ec5cc4f/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:37.068468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6376415c34e9402795968fddb28f328d, user_id=01066839d29b43fa94eca2329ec5cc4f, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:37.071606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:37.096931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1022/2038] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:37 2022] PUT /identity/v3/projects/6376415c34e9402795968fddb28f328d/users/01066839d29b43fa94eca2329ec5cc4f/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:37.097789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b7d12-c254-4181-96b7-1a942f335d0d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:37.098081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b7d12-c254-4181-96b7-1a942f335d0d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:37.098358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b7d12-c254-4181-96b7-1a942f335d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:37.148600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cf4b7d12-c254-4181-96b7-1a942f335d0d None None] MFA Rules not processed for user `01066839d29b43fa94eca2329ec5cc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:37.150374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cf4b7d12-c254-4181-96b7-1a942f335d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:37.361831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1017/2039] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:37.375888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:37.378236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:37.455301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:37.486361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c816f9a-8d48-4560-b39c-6a68f798529f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:37.492536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55349-7ccb-485c-ac74-019e7007a4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:37.493175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55349-7ccb-485c-ac74-019e7007a4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:37.493898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55349-7ccb-485c-ac74-019e7007a4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:37.494413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55349-7ccb-485c-ac74-019e7007a4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:37.625582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55349-7ccb-485c-ac74-019e7007a4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:37.627541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55349-7ccb-485c-ac74-019e7007a4c4 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:37.662034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1023/2040] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:38.275054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c03c-eb96-4bb0-a2e3-927cdf597328 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.275348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c03c-eb96-4bb0-a2e3-927cdf597328 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.275626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c03c-eb96-4bb0-a2e3-927cdf597328 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.277168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1018/2041] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:30:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:30:38.301054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2576f-072e-465e-98a1-3a2b1ef3d147 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.301347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2576f-072e-465e-98a1-3a2b1ef3d147 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.301623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2576f-072e-465e-98a1-3a2b1ef3d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.322634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6eb2576f-072e-465e-98a1-3a2b1ef3d147 None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:38.324185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6eb2576f-072e-465e-98a1-3a2b1ef3d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:38.392352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c03c-eb96-4bb0-a2e3-927cdf597328 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:38.394417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5fd2c03c-eb96-4bb0-a2e3-927cdf597328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:38.429451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:38.430635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1024/2042] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:38.443398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137665d-0545-4049-9b0e-9c3241661392 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.443685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137665d-0545-4049-9b0e-9c3241661392 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.444697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137665d-0545-4049-9b0e-9c3241661392 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.446079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1025/2043] 10.222.0.25 () {54 vars in 961 bytes} [Thu Sep 22 12:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:30:38.450770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.451051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.451317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.474350 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:38.476811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:38.478953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c03c-eb96-4bb0-a2e3-927cdf597328 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:38.484872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:38.485520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.485803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.486080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] PATH_INFO: `/v3/users/d8526f34161848debbce7a8622cef3ac` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.487743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8526f34161848debbce7a8622cef3ac)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:38.489990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:38.494046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1026/2044] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Sep 22 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:38.508337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:38.523356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ef8ac-c438-4a4d-aed0-ce24f1107661 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:38.529381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:38.530405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.530747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.531160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.542693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:38.545386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:38.567584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1027/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:38.582383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8526f34161848debbce7a8622cef3ac'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:38.606361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8526f34161848debbce7a8622cef3ac'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:38.607449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8526f34161848debbce7a8622cef3ac'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:38.625209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8526f34161848debbce7a8622cef3ac'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:38.644207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0ef2e414-552e-4e6e-95eb-c767f9d5df64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8526f34161848debbce7a8622cef3ac'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:38.656050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1019/2046] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:38 2022] DELETE /identity/v3/users/d8526f34161848debbce7a8622cef3ac => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:38.898285 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:38.910484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb81cca-8b53-40da-9c68-3992b76b66fd service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:38.983181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:38.984235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:38.984526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:38.984883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] PATH_INFO: `/v3/projects/7cd37a54181d448c935fa94b59d9ae2a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:38.986331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd37a54181d448c935fa94b59d9ae2a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:38.988381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:38.990830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:39.043307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd37a54181d448c935fa94b59d9ae2a', 'request_id': 'req-15867949-e9cf-48c4-8472-7b7a8ee33f1a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:39.054291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd37a54181d448c935fa94b59d9ae2a', 'request_id': 'req-15867949-e9cf-48c4-8472-7b7a8ee33f1a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:39.061515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd37a54181d448c935fa94b59d9ae2a', 'request_id': 'req-15867949-e9cf-48c4-8472-7b7a8ee33f1a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:39.073801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] The token cache is being invalidate because project 7cd37a54181d448c935fa94b59d9ae2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:39.074147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:39.075149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-15867949-e9cf-48c4-8472-7b7a8ee33f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:39.076880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1028/2047] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:38 2022] DELETE /identity/v3/projects/7cd37a54181d448c935fa94b59d9ae2a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:39.081774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.082130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.082430 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.106608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:39.108449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:39.192348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1020/2048] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:39.200042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.200353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.200633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.237869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:39.239254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:39.253957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1029/2049] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:39.258523 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.285793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef0dd6-4417-45b7-ab0a-883f822b5862 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.294572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.296363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.296955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.297585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.298750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:39.300506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.303049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.332321 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1021/2050] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:39.333212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.345173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8daf-8600-410c-8f8f-6fa03a0194a2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.351963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.353768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.354052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.354307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.354958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.357003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.437382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1030/2051] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:39 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:39.441507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.457179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97c6a3-fdea-45fd-a931-b402ec4b0378 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.488977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.492466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:39.514286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:39.566348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.566964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.567245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.567520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.568301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.571287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.605593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1022/2052] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:39 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:39.610944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.625119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9ae5-426f-4fab-afa0-cc08743a3499 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.626641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709f5e7-1a22-45b5-8f5e-d620f55833ca admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.631001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.631482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.632070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.632310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.632753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.632992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.633348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.633525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.634190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.635866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.636129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:39.658221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1023/2053] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:39.664653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.679423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a450b4-7e23-4a13-84ac-ebcf16eac42b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.686691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.687353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.687754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.688144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.688808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.690886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.704050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1024/2054] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:39.708701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.723434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b466-dc77-442b-a4f5-cee26fd2affd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:39.730006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:39.730764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.731046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.731325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] PATH_INFO: `/v3/projects/71cbe4e0ba0e42a7b6bcb6bcfc730fc0/users/961dd70705aa4b5397e3e336363b5148/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.733550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.735228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a78cf-8e75-4995-b172-a1b2ded3f95c service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.745451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1031/2055] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:39.756086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cbe4e0ba0e42a7b6bcb6bcfc730fc0, user_id=961dd70705aa4b5397e3e336363b5148, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:39.758917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:39.774067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1025/2056] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:39 2022] PUT /identity/v3/projects/71cbe4e0ba0e42a7b6bcb6bcfc730fc0/users/961dd70705aa4b5397e3e336363b5148/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:39.784684 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:39.784966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:39.785239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:39.827819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] MFA Rules not processed for user `961dd70705aa4b5397e3e336363b5148`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:39.829213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:39.836442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:39.919147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1032/2057] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:39.941954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:39.944560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.040796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3671fb-93f5-4115-bfc3-4d663ea7ff06 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:40.048458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:40.049139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.049466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.049750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.059357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:40.062138 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:40.075185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1026/2058] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:40.353669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:40.431270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:40.433059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.434471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693574b-a105-4a8b-9a21-4f4620407fef None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:40.442536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:40.443200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.443574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.443735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] PATH_INFO: `/v3/users/961dd70705aa4b5397e3e336363b5148` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.445030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=961dd70705aa4b5397e3e336363b5148)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:40.447061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:40.533053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57da9a-49fe-44ec-becf-10aee3263070 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:40.534164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961dd70705aa4b5397e3e336363b5148'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.537661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:40.538270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.538849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.539431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.541378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.543163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961dd70705aa4b5397e3e336363b5148'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.543979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961dd70705aa4b5397e3e336363b5148'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.555392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961dd70705aa4b5397e3e336363b5148'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.562136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:40.572086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961dd70705aa4b5397e3e336363b5148'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.579142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1033/2059] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:40 2022] DELETE /identity/v3/users/961dd70705aa4b5397e3e336363b5148 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:40.580841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:40.583431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.622683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:40.624654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e98c8-9a96-4801-8fca-90e37be31631 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:40.627354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:40.635247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1027/2060] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:40.636959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.637392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.637515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.665613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:40.667355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.689550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994edbb-62e8-4afd-88dd-5c74aaa4da3e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:40.700743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:40.704400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.704946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.705696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] PATH_INFO: `/v3/users/68f04e2750f04aecb3095fc2fc80f48f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.709800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f04e2750f04aecb3095fc2fc80f48f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:40.712136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:40.777603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1028/2061] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:40.793317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:40.796800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.823408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f04e2750f04aecb3095fc2fc80f48f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.841965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f04e2750f04aecb3095fc2fc80f48f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.842968 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f04e2750f04aecb3095fc2fc80f48f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.853161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f04e2750f04aecb3095fc2fc80f48f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.868996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a85ff7c2-a39f-45e4-9406-eb00b7312bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f04e2750f04aecb3095fc2fc80f48f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:40.880412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1034/2062] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:40 2022] DELETE /identity/v3/users/68f04e2750f04aecb3095fc2fc80f48f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:40.885919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343d255-ec81-4666-a782-553dbe738297 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.886422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343d255-ec81-4666-a782-553dbe738297 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.886809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343d255-ec81-4666-a782-553dbe738297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.909365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2a908-af54-43ac-b1b6-f016ee3b3f1b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:40.913886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4343d255-ec81-4666-a782-553dbe738297 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:40.915095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4343d255-ec81-4666-a782-553dbe738297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.967813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:40.968873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:40.969399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:40.969831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:40.975374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:40.999697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:41.003008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1035/2063] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:41.014045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343d255-ec81-4666-a782-553dbe738297 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.015600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4343d255-ec81-4666-a782-553dbe738297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.033269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343d255-ec81-4666-a782-553dbe738297 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.042560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.043641 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.043920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.044611 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.055382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.056843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.059477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.060978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.069551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1036/2064] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:41.071477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1029/2065] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:41.498182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.500831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.515393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.518608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.537599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827378b-978b-4ded-86a2-5b2f59abe600 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.542128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df312cd-c35b-4608-99fe-1b0f90417ce6 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.550243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.550899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.551172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.551641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] PATH_INFO: `/v3/projects/ce4978a987d84c3d8e7868a3d487c727` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.553188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4978a987d84c3d8e7868a3d487c727)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.556467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.557935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.558578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.558855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.559124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] PATH_INFO: `/v3/projects/71cbe4e0ba0e42a7b6bcb6bcfc730fc0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.562036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71cbe4e0ba0e42a7b6bcb6bcfc730fc0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.566247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.635721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4978a987d84c3d8e7868a3d487c727', 'request_id': 'req-8a12874f-4801-42f8-8177-4dd57e33ec8e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.646461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:41.647229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4978a987d84c3d8e7868a3d487c727', 'request_id': 'req-8a12874f-4801-42f8-8177-4dd57e33ec8e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.657727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4978a987d84c3d8e7868a3d487c727', 'request_id': 'req-8a12874f-4801-42f8-8177-4dd57e33ec8e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.674931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cbe4e0ba0e42a7b6bcb6bcfc730fc0', 'request_id': 'req-454a3689-6404-42dc-80ac-8c023a1e0147'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.675125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] The token cache is being invalidate because project ce4978a987d84c3d8e7868a3d487c727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:41.675125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.675304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8a12874f-4801-42f8-8177-4dd57e33ec8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.680025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1030/2066] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:41 2022] DELETE /identity/v3/projects/ce4978a987d84c3d8e7868a3d487c727 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:41.682349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ce57-71d4-43f1-87e9-4636c13a3dc2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.682696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ce57-71d4-43f1-87e9-4636c13a3dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.682949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ce57-71d4-43f1-87e9-4636c13a3dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.686991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cbe4e0ba0e42a7b6bcb6bcfc730fc0', 'request_id': 'req-454a3689-6404-42dc-80ac-8c023a1e0147'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.694727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cbe4e0ba0e42a7b6bcb6bcfc730fc0', 'request_id': 'req-454a3689-6404-42dc-80ac-8c023a1e0147'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.704575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1dc9ce57-71d4-43f1-87e9-4636c13a3dc2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:41.706305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1dc9ce57-71d4-43f1-87e9-4636c13a3dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.710202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] The token cache is being invalidate because project 71cbe4e0ba0e42a7b6bcb6bcfc730fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:41.710647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.711356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-454a3689-6404-42dc-80ac-8c023a1e0147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:41.713039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1037/2067] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:41 2022] DELETE /identity/v3/projects/71cbe4e0ba0e42a7b6bcb6bcfc730fc0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:41.719405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496255-be91-4bd7-8e4e-0b1d1f839464 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.720275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496255-be91-4bd7-8e4e-0b1d1f839464 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.720550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496255-be91-4bd7-8e4e-0b1d1f839464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.747451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-35496255-be91-4bd7-8e4e-0b1d1f839464 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:41.749178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-35496255-be91-4bd7-8e4e-0b1d1f839464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.781716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1031/2068] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:41.789563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.789834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.790119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.815203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:41.816486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.818807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1038/2069] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:41.830595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1032/2070] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:41.831071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.831071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.831071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.832596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.845255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9277ce-9dfe-4041-a2c7-ad0f1dd6b191 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.850874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.851485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.851897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.852207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.852966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:41.853170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.855787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.862198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:41.865147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:41.878332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1033/2071] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:41.878652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1039/2072] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:41.879664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.882892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.891621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3473-fd49-4ae8-b1d4-c42d07210259 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.896432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbce42-40dd-45db-af1e-bcc39ee9537d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.897931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.898923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.899481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.900285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.900980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.903688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.903688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.903917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.904273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.905489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:41.905793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.906215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.907425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:41.929674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1040/2073] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:41.931589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.948892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9cf7-f3c7-499d-a964-c501b0039b00 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:41.949410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:41.965013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:41.965791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:41.966139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:41.966628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1034/2074] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:41.970441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:41.970441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:41.971694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:41.972004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.015150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1041/2075] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:42.016726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.134110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1adf7-5fc8-4a4b-b454-b00cfe320a9c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.138597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20a7c-5b57-4fa4-9848-f7e1af5ee148 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.143428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.144534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.144959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.145384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.150059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.150516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.150992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.151368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.151750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.152633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.154379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.156845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.194784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1035/2076] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:41 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:42.195763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.210281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8808ce-62fb-438a-863c-0657d27e6bfb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.231006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.242770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1042/2077] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:42.244288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.245933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.246468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.247052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.249319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.253502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:42.256461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86298c3-b92f-405f-aae9-6f88dcb45634 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.259210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.263410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.265263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.265577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.266166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.267462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.271082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.284108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1036/2078] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:42.287095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.290264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1043/2079] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:42.292017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.307980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08255159-34ee-4269-9ca8-638d34940afc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.311797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a2a2-6d8a-447a-bd92-2982269ecfef admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.319087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.328581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.328581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.328581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.328581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.328581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.329286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.329286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.329286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.329286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.329947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.329947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.344555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1037/2080] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:42.345364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1044/2081] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:42.349349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.350604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.365674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8dad-69e1-4e0c-8a4c-fc8b92fb05cb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.367692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7a3b0-a3e7-4a63-821d-b294ad6524c1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.376063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b73606-f694-4f4c-bad6-427cf9effb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.376780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697acd0-9729-4272-948a-6f4fc3d9184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.376908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b73606-f694-4f4c-bad6-427cf9effb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.377076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b73606-f694-4f4c-bad6-427cf9effb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.377325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b73606-f694-4f4c-bad6-427cf9effb12 admin admin] PATH_INFO: `/v3/projects/778ff19ef8544965b133ffb1fd20accf/users/47c065039aed4ebf9e94ee2d881564cd/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.377634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697acd0-9729-4272-948a-6f4fc3d9184d admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.378259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697acd0-9729-4272-948a-6f4fc3d9184d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.378592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697acd0-9729-4272-948a-6f4fc3d9184d admin admin] PATH_INFO: `/v3/projects/3cf064bb87df4b41928537e360faf6e9/users/c9f5dd879d4f4beb88ffc6b3992275e8/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.393979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b73606-f694-4f4c-bad6-427cf9effb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778ff19ef8544965b133ffb1fd20accf, user_id=47c065039aed4ebf9e94ee2d881564cd, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.397223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b73606-f694-4f4c-bad6-427cf9effb12 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.397924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697acd0-9729-4272-948a-6f4fc3d9184d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf064bb87df4b41928537e360faf6e9, user_id=c9f5dd879d4f4beb88ffc6b3992275e8, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.401212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697acd0-9729-4272-948a-6f4fc3d9184d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.415860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1045/2082] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:42 2022] PUT /identity/v3/projects/778ff19ef8544965b133ffb1fd20accf/users/47c065039aed4ebf9e94ee2d881564cd/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:42.419377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1038/2083] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:42 2022] PUT /identity/v3/projects/3cf064bb87df4b41928537e360faf6e9/users/c9f5dd879d4f4beb88ffc6b3992275e8/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:42.426875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.427165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.427439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.430685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.430973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.431286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.457207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] MFA Rules not processed for user `47c065039aed4ebf9e94ee2d881564cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:42.458416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:42.466375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] MFA Rules not processed for user `c9f5dd879d4f4beb88ffc6b3992275e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:42.468314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:42.540223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1046/2084] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:42.542428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.546225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1039/2085] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:42.550856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.587440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:42.620730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d2687-7635-46ac-8369-658ee4f6501a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.624350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb86473-89a7-48cd-b76b-c7b3186b7310 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.627666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.629760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.630103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.630367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.630653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.630923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.631269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.631558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.631843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.632663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.633786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.634929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.674021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1047/2086] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:42.683987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.691021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1040/2087] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:42.695195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.723325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:42.764732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a3e5-a0b9-4579-a6c7-75859c535a82 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.770614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.771424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.771712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.772020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.772698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.774338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574cf4-cc63-4ff2-9f0e-976a937b32ae admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.774713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.781727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.781727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.781981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.782201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.783961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.784942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.810984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1041/2088] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:42.814920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1048/2089] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:42.815075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.818991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.826392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc0cc0-5390-4364-b20c-168f4d3ad5f5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.831648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f302a7-50b3-4440-b370-72a03c80e207 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.832884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.833602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.833886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.834161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.834809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.836642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.836764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.837408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.837686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.837959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.838676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.840379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.848827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1042/2090] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:42.855352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1049/2091] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:42.855565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.856536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.864965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd1963-77d3-4ee2-af19-06ae19df424d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.866970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dace1-59ec-4f7e-89e7-66e7fb6181f4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.870386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.870924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.871202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.871474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.871898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.872150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.872587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.872866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.873138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] PATH_INFO: `/v3/projects/48e83f2b499d4373ac38c7e853ad1ead/users/1f900905304b4f1da814fc07ac4cbba2/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.874452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.886774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1043/2092] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:42.891121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.891809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e83f2b499d4373ac38c7e853ad1ead, user_id=1f900905304b4f1da814fc07ac4cbba2, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.895744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.904291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1a5cb-6e09-419e-989f-2cc05f3cfcdb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:42.910510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e868101-9493-411b-b537-a8416d039f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:42.911180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868101-9493-411b-b537-a8416d039f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.911508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868101-9493-411b-b537-a8416d039f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.911791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e868101-9493-411b-b537-a8416d039f81 admin admin] PATH_INFO: `/v3/projects/47426622812540ec901056c78cea321e/users/5d30a1e4ca0d4e82b9ea2096990ccfef/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.914326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1050/2093] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:42 2022] PUT /identity/v3/projects/48e83f2b499d4373ac38c7e853ad1ead/users/1f900905304b4f1da814fc07ac4cbba2/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:42.918638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:42.929356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e868101-9493-411b-b537-a8416d039f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47426622812540ec901056c78cea321e, user_id=5d30a1e4ca0d4e82b9ea2096990ccfef, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:42.932197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e868101-9493-411b-b537-a8416d039f81 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:42.951223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1044/2094] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:42 2022] PUT /identity/v3/projects/47426622812540ec901056c78cea321e/users/5d30a1e4ca0d4e82b9ea2096990ccfef/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:42.962595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:42.962880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:42.963242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:42.993468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] MFA Rules not processed for user `5d30a1e4ca0d4e82b9ea2096990ccfef`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:42.994926 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:42.997346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee32fd-933d-4cc3-983d-37efb82d0b27 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.055769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:43.078639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.079178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.079453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.079779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.080453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.081399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1045/2095] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:43.082173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.085723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.093751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1051/2096] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:43.097876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f36570-d54d-41db-afb9-2f90dbba0123 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.099311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.107049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aa8eb-ba07-4fb1-a9e8-0366d40eac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.107591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa8eb-ba07-4fb1-a9e8-0366d40eac87 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.108447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa8eb-ba07-4fb1-a9e8-0366d40eac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.108728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aa8eb-ba07-4fb1-a9e8-0366d40eac87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.109519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa8eb-ba07-4fb1-a9e8-0366d40eac87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.111287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aa8eb-ba07-4fb1-a9e8-0366d40eac87 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.112632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7845a3-072c-4c58-9d90-e59779a0d074 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.118609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.119274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.120221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.120408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] PATH_INFO: `/v3/projects/48e83f2b499d4373ac38c7e853ad1ead/users/1f900905304b4f1da814fc07ac4cbba2/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.122541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e83f2b499d4373ac38c7e853ad1ead, user_id=1f900905304b4f1da814fc07ac4cbba2, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.126681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.139912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1052/2097] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:43 2022] PUT /identity/v3/projects/48e83f2b499d4373ac38c7e853ad1ead/users/1f900905304b4f1da814fc07ac4cbba2/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:43.146107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1046/2098] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:43 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:43.152672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.153135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.153476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.153766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.178012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:43.192063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] MFA Rules not processed for user `1f900905304b4f1da814fc07ac4cbba2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:43.194230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:43.234964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c62f-ef50-4bee-9f2a-1801e3f46de7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.293699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1047/2099] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:43.313515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.314933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:43.318965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.319591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.319869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.320542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.321303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.323651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.356212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1053/2100] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:43 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:43.360346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.380155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd135-6438-4779-a7eb-b9a403aacb13 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.392083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.392847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.394175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.394681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.395416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.399242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.422197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1054/2101] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:43.425572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.436833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326567ac-d054-4fe0-b7ba-96f0f0209891 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.448819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71a47-5565-4e45-85ee-371d77638c8e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.450159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.450286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.450533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.450808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.456112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.456994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.457526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.457929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] PATH_INFO: `/v3/projects/8d459139f8c3468c948f93492b4d0298/users/2cafd0a63b0245a09ca0a370a22b40b7/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.475840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.477646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.489535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1048/2102] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:43.492290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d459139f8c3468c948f93492b4d0298, user_id=2cafd0a63b0245a09ca0a370a22b40b7, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.495913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.519113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1055/2103] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:43 2022] PUT /identity/v3/projects/8d459139f8c3468c948f93492b4d0298/users/2cafd0a63b0245a09ca0a370a22b40b7/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:43.529012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.530682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.551493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b426-678a-4404-ad70-cd4d95c57743 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.629090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55908c1-1c0c-4b28-8e79-f06c01aa66e7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.636047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.637003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.637649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.637760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:43.637851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] PATH_INFO: `/v3/users/47c065039aed4ebf9e94ee2d881564cd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.640292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c065039aed4ebf9e94ee2d881564cd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.650007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.654315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.656016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.656336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.656771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.657673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.659357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.671868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1049/2104] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:43.675736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.686204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd59c29-750b-4c1a-a8d5-93af21d85eee admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:43.691746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7328ed5-d5c1-484b-85a7-407ddee37b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:43.692462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7328ed5-d5c1-484b-85a7-407ddee37b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.692745 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7328ed5-d5c1-484b-85a7-407ddee37b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.693019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7328ed5-d5c1-484b-85a7-407ddee37b0c admin admin] PATH_INFO: `/v3/projects/8d459139f8c3468c948f93492b4d0298/users/2cafd0a63b0245a09ca0a370a22b40b7/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.694635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:43.695628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7328ed5-d5c1-484b-85a7-407ddee37b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d459139f8c3468c948f93492b4d0298, user_id=2cafd0a63b0245a09ca0a370a22b40b7, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:43.699736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7328ed5-d5c1-484b-85a7-407ddee37b0c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:43.731883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1050/2105] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:43 2022] PUT /identity/v3/projects/8d459139f8c3468c948f93492b4d0298/users/2cafd0a63b0245a09ca0a370a22b40b7/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:43.742411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.742700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.742975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.750359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c065039aed4ebf9e94ee2d881564cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:43.763246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c065039aed4ebf9e94ee2d881564cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:43.764679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c065039aed4ebf9e94ee2d881564cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:43.782868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c065039aed4ebf9e94ee2d881564cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:43.791423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] MFA Rules not processed for user `2cafd0a63b0245a09ca0a370a22b40b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:43.793206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:43.804496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8ae62c44-8d63-484d-a019-7a5a16c8fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c065039aed4ebf9e94ee2d881564cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:43.817362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1056/2106] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:43 2022] DELETE /identity/v3/users/47c065039aed4ebf9e94ee2d881564cd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:43.821716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:43.822006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:43.822287 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:43.851344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:43.852779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:43.911526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1051/2107] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:43.922816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.925062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:43.969409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1057/2108] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:43.987691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:43.991491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:44.024845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ca699-9a16-4e31-8759-5dce2c8c8e6e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:44.059233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137196da-3dd6-4ccb-87be-edfb9b3b4eba None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:44.064091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:44.064886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:44.065236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:44.065594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:44.078749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:44.081122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:44.082066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:44.082247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:44.082641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:44.082956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:44.084825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:44.095068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1058/2109] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:44.129644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:44.171637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:44.173419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:44.192323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1052/2110] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:44.435639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:44.437226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:44.455121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574adea1-8047-49ea-8c24-b8517ad28990 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:44.460090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:44.461832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:44.462174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:44.462724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] PATH_INFO: `/v3/projects/778ff19ef8544965b133ffb1fd20accf` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:44.472514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778ff19ef8544965b133ffb1fd20accf)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:44.474539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:44.561991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:44.585501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778ff19ef8544965b133ffb1fd20accf', 'request_id': 'req-534c3268-a7cc-477c-bade-c14d6d133001'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.601983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778ff19ef8544965b133ffb1fd20accf', 'request_id': 'req-534c3268-a7cc-477c-bade-c14d6d133001'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.611743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778ff19ef8544965b133ffb1fd20accf', 'request_id': 'req-534c3268-a7cc-477c-bade-c14d6d133001'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.634043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] The token cache is being invalidate because project 778ff19ef8544965b133ffb1fd20accf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:44.634043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.635090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.637253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1059/2111] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:44 2022] DELETE /identity/v3/projects/778ff19ef8544965b133ffb1fd20accf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:44.643329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:44.659738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021880ad-f709-4275-8f48-50d4619ee6ce service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:44.734418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:44.736637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:44.736637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:44.736637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] PATH_INFO: `/v3/users/1f900905304b4f1da814fc07ac4cbba2` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:44.737713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f900905304b4f1da814fc07ac4cbba2)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:44.740156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:44.795683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f900905304b4f1da814fc07ac4cbba2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.805594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f900905304b4f1da814fc07ac4cbba2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.806346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f900905304b4f1da814fc07ac4cbba2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.815153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f900905304b4f1da814fc07ac4cbba2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.829053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f900905304b4f1da814fc07ac4cbba2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:44.835725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1053/2112] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:44 2022] DELETE /identity/v3/users/1f900905304b4f1da814fc07ac4cbba2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:45.093563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.097432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.116414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c3268-a7cc-477c-bade-c14d6d133001 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.161209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.163190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.215201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.217742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.217742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.217742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] PATH_INFO: `/v3/users/358bf1d94e414c92a8710c412ec4d6df` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.218120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358bf1d94e414c92a8710c412ec4d6df)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.220704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.247682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:45.266133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5608-96a7-4865-8677-9a0288bb8d26 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.272590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.273312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.273661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.274010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] PATH_INFO: `/v3/projects/48e83f2b499d4373ac38c7e853ad1ead` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.275190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e83f2b499d4373ac38c7e853ad1ead)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.277550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.287554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358bf1d94e414c92a8710c412ec4d6df'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.297223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358bf1d94e414c92a8710c412ec4d6df'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.297880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358bf1d94e414c92a8710c412ec4d6df'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.305596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358bf1d94e414c92a8710c412ec4d6df'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.322259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7ad26620-d2ef-4bc6-8e45-d0c29ba685d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358bf1d94e414c92a8710c412ec4d6df'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.329830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1060/2113] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:45 2022] DELETE /identity/v3/users/358bf1d94e414c92a8710c412ec4d6df => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:45.336806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.337088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.337362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.338789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e83f2b499d4373ac38c7e853ad1ead', 'request_id': 'req-261a7d7a-6917-49fd-ac3b-a3c989b857bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.350511 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e83f2b499d4373ac38c7e853ad1ead', 'request_id': 'req-261a7d7a-6917-49fd-ac3b-a3c989b857bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.356828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e83f2b499d4373ac38c7e853ad1ead', 'request_id': 'req-261a7d7a-6917-49fd-ac3b-a3c989b857bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.361253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:45.362813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.370076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] The token cache is being invalidate because project 48e83f2b499d4373ac38c7e853ad1ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:45.370385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.370948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-261a7d7a-6917-49fd-ac3b-a3c989b857bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:45.373154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1054/2114] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:45 2022] DELETE /identity/v3/projects/48e83f2b499d4373ac38c7e853ad1ead => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:45.378236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cbd3-d9a1-48b6-8890-1a92f733d6e0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.378526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cbd3-d9a1-48b6-8890-1a92f733d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.378816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cbd3-d9a1-48b6-8890-1a92f733d6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.404226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2037cbd3-d9a1-48b6-8890-1a92f733d6e0 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:45.405981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2037cbd3-d9a1-48b6-8890-1a92f733d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.421011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:45.454730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1061/2115] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:45.462725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.463871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.484735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1055/2116] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:45.493654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.493946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.495255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.518151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:45.521819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.533240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1056/2117] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:45.535064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4ab8a-1f09-4ec0-ab2f-43c78061e51e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.537110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.539196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.539804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.540138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.540469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.549017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf80d9-d1ba-45e7-b633-5219efd64aa5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.552950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.554437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.555228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.555861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.556578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.556864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.557520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:45.557825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.560297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.566534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1062/2118] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:45.578920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1057/2119] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:30:45.585812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.604269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686d11-b062-42e3-b2b6-f7b20a26247a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.615134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.615746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.616067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.616343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.616995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.620059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.658484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.665797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1063/2120] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:45 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:45.671439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baf0f3-6f46-4259-b57a-3b70808ed895 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.785535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.786211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.786427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.787208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.787863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.791012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.809694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:45.840733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.848402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1058/2121] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:45 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:45.855451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512186e5-c4af-4291-9cbb-e7a325f09152 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.876400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.878358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.878643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.878913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.879592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.881189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.906730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1064/2122] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:45.909835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.937768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70619d44-41d3-4f39-b431-68a8e91f7675 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:45.946326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:45.946966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:45.947246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:45.947519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:45.948268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:45.949913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:45.973240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.974971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1059/2123] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:45.979765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:45.979952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:45.993841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57002346-283f-4f36-b95e-f0f1b797fc92 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.000484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71623cc4-d1c7-4a5e-a54e-d72169214c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.001152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71623cc4-d1c7-4a5e-a54e-d72169214c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.001595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71623cc4-d1c7-4a5e-a54e-d72169214c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.001951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71623cc4-d1c7-4a5e-a54e-d72169214c35 admin admin] PATH_INFO: `/v3/projects/c7de8aac13cf48b49d99af0fea654356/users/3153815c64dd45a2a718033129c74000/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.024261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71623cc4-d1c7-4a5e-a54e-d72169214c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7de8aac13cf48b49d99af0fea654356, user_id=3153815c64dd45a2a718033129c74000, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.028805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71623cc4-d1c7-4a5e-a54e-d72169214c35 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.054953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1060/2124] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:45 2022] PUT /identity/v3/projects/c7de8aac13cf48b49d99af0fea654356/users/3153815c64dd45a2a718033129c74000/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:46.067095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.067095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.067095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.083580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ef9f0-3171-4395-b0c6-dad3364634af admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.120058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] MFA Rules not processed for user `3153815c64dd45a2a718033129c74000`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:46.120058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:46.171043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.171679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.172214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.172214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.175682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:46.214493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:46.219217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1061/2125] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:46.223677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.225225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:46.262637 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.264698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.275307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1065/2126] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:46.277176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.315328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd76ba5-c68a-4c29-9f03-9761e6bc914e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.322573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.323419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.323706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.324059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] PATH_INFO: `/v3/projects/d3170c4fbf73405e9d90f27f3b4ba2e5` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.328851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3170c4fbf73405e9d90f27f3b4ba2e5)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.330791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.377189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f42e-43ca-4ddc-a520-192d7e417494 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.396825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3170c4fbf73405e9d90f27f3b4ba2e5', 'request_id': 'req-f9495337-3269-4b1f-861f-6ceab9ab92ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.401542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:46.410685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3170c4fbf73405e9d90f27f3b4ba2e5', 'request_id': 'req-f9495337-3269-4b1f-861f-6ceab9ab92ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.428229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3170c4fbf73405e9d90f27f3b4ba2e5', 'request_id': 'req-f9495337-3269-4b1f-861f-6ceab9ab92ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.444683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] The token cache is being invalidate because project d3170c4fbf73405e9d90f27f3b4ba2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:46.445247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.446570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.451515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1062/2127] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:46 2022] DELETE /identity/v3/projects/d3170c4fbf73405e9d90f27f3b4ba2e5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:46.455059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.457352 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:46.466295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.467235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.467671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.468146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.468940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.471515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.515967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1066/2128] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:46 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:46.519612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.522478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:46.558405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495337-3269-4b1f-861f-6ceab9ab92ec admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.607237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:46.613964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46de7-0d72-4cb0-8018-2d40eef58178 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.631329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.632079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.632362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.632634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.633277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.635234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.668036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.668691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.669153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.669292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] PATH_INFO: `/v3/users/0ef11030e01c41fb9c61a9d5da211ff1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.670092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1067/2129] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:46 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:46.673152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef11030e01c41fb9c61a9d5da211ff1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.675087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.676656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.692565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276513f-0e7b-4f46-9ae9-08a4ee4264bd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.698547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.699163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.699444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.699714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.700455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.702294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.714415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1068/2130] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:46.720212 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.735706 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9744a-52e3-45ed-8fe6-ae2bd8d4fb09 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:46.743553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:46.744360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:46.745092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:46.745464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] PATH_INFO: `/v3/projects/919f7d2799c84467ae9191cd801cfb81/users/3c9eb2d8f03d4127850d7cc05a560ee0/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:46.760204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef11030e01c41fb9c61a9d5da211ff1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.773763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=919f7d2799c84467ae9191cd801cfb81, user_id=3c9eb2d8f03d4127850d7cc05a560ee0, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:46.775510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef11030e01c41fb9c61a9d5da211ff1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.776872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef11030e01c41fb9c61a9d5da211ff1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.777520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:46.789571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef11030e01c41fb9c61a9d5da211ff1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.799844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1069/2131] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:46 2022] PUT /identity/v3/projects/919f7d2799c84467ae9191cd801cfb81/users/3c9eb2d8f03d4127850d7cc05a560ee0/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:30:46.800799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:46.803232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:46.808725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef11030e01c41fb9c61a9d5da211ff1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:46.822907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1063/2132] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:46 2022] DELETE /identity/v3/users/0ef11030e01c41fb9c61a9d5da211ff1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:46.897263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4aff-741f-4b5a-bcdd-c1533695d01d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:47.013083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac394-e038-4af7-b255-51fdfcfdd4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:47.013715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac394-e038-4af7-b255-51fdfcfdd4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.014025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac394-e038-4af7-b255-51fdfcfdd4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.014302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac394-e038-4af7-b255-51fdfcfdd4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.014957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ac394-e038-4af7-b255-51fdfcfdd4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:47.016600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ac394-e038-4af7-b255-51fdfcfdd4bf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:47.034511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1070/2133] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:47.040303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:47.054598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:47.060333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a709-6685-46a4-b2e5-92ba70efd562 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:47.066944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:47.071288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.071288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.071288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] PATH_INFO: `/v3/projects/919f7d2799c84467ae9191cd801cfb81/users/3c9eb2d8f03d4127850d7cc05a560ee0/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.078597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919f7d2799c84467ae9191cd801cfb81, user_id=3c9eb2d8f03d4127850d7cc05a560ee0, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:47.082737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:47.111726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1064/2134] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:47 2022] PUT /identity/v3/projects/919f7d2799c84467ae9191cd801cfb81/users/3c9eb2d8f03d4127850d7cc05a560ee0/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:47.113933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.114214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.114439 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.140963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:47.146179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.177112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] MFA Rules not processed for user `3c9eb2d8f03d4127850d7cc05a560ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:47.179263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.252748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:47.301885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a3389-f24e-4074-b2db-e43fbf881324 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:47.309913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:47.313695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1071/2135] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:47.313835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.313835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.313835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.314087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:47.315389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.343052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.421076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:47.422680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:47.434242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1065/2136] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:30:47.435652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:47.437180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.447253 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84625fee-ae40-4c63-853e-71ed771d2323 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:47.453094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede3a7b-20ee-4a6d-a72f-11b919fbe6b9 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:47.457145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:47.457843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.458039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:47.458195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.458572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.459166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.459470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.459743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] PATH_INFO: `/v3/projects/52a26b8677b94b6c9be8d11a9dcca759` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.461025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a26b8677b94b6c9be8d11a9dcca759)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:47.461687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.462981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:47.535374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a26b8677b94b6c9be8d11a9dcca759', 'request_id': 'req-5471f941-0e09-4d99-933f-99d2d03985ab'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.548427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a26b8677b94b6c9be8d11a9dcca759', 'request_id': 'req-5471f941-0e09-4d99-933f-99d2d03985ab'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.556007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a26b8677b94b6c9be8d11a9dcca759', 'request_id': 'req-5471f941-0e09-4d99-933f-99d2d03985ab'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.573511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] The token cache is being invalidate because project 52a26b8677b94b6c9be8d11a9dcca759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:47.573732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.574746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.577488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1072/2137] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:47 2022] DELETE /identity/v3/projects/52a26b8677b94b6c9be8d11a9dcca759 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:47.578007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:47.579668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:47.584736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:47.586941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:47.613555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1066/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:47.677648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f941-0e09-4d99-933f-99d2d03985ab admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:47.684976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:47.686416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:47.686707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:47.686985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] PATH_INFO: `/v3/users/01066839d29b43fa94eca2329ec5cc4f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:47.688318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01066839d29b43fa94eca2329ec5cc4f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:47.691358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:47.713171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:47.759846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01066839d29b43fa94eca2329ec5cc4f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.768993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01066839d29b43fa94eca2329ec5cc4f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.769891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01066839d29b43fa94eca2329ec5cc4f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.780632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01066839d29b43fa94eca2329ec5cc4f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.802645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ef4f68cc-09ab-4dd8-9b2c-2078949a6f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01066839d29b43fa94eca2329ec5cc4f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:47.810053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1073/2139] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:47 2022] DELETE /identity/v3/users/01066839d29b43fa94eca2329ec5cc4f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:48.194606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.210322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e3d9-da05-47d9-9e2c-9aefa0de4bc2 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.261801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:48.281858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.282415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.282690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.282955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] PATH_INFO: `/v3/projects/6376415c34e9402795968fddb28f328d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.284092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6376415c34e9402795968fddb28f328d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.285993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.334534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6376415c34e9402795968fddb28f328d', 'request_id': 'req-76145dbc-2efc-4c73-b64b-4482da0c89a1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:48.343051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6376415c34e9402795968fddb28f328d', 'request_id': 'req-76145dbc-2efc-4c73-b64b-4482da0c89a1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:48.348909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6376415c34e9402795968fddb28f328d', 'request_id': 'req-76145dbc-2efc-4c73-b64b-4482da0c89a1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:48.361862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] The token cache is being invalidate because project 6376415c34e9402795968fddb28f328d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:48.362048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:48.362716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-76145dbc-2efc-4c73-b64b-4482da0c89a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:48.364587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1067/2140] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:48 2022] DELETE /identity/v3/projects/6376415c34e9402795968fddb28f328d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:48.369443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.369759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.370284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.392842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:48.395615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:48.471080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1074/2141] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:48.479150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.479431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.479700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.501832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:48.503199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:48.512635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1068/2142] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:48.517165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.530237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93290abf-6f37-4dff-953a-2fdd0bc34677 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.537474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.538711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.538711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.538711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.539171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:48.539484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.541137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.556020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1075/2143] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:48.558317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.568510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd3440-dec1-4427-b0a8-168282f3927f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.574566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.575198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.575481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.575755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.576491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.578883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.611981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1069/2144] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:48 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:48.613901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.625040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882563d-7eda-4d23-a15f-753245de8a02 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.686841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.687508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.687790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.688025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.688878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.691069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.716041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1076/2145] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:48 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:48.718773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.730879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffedddb-56f4-4868-9384-a0c0363b3d73 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.736287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.736902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.737245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.737518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.738156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.739740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.750815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1070/2146] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:48.755215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.766680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d8d19-dabc-404f-8168-ae069707bc09 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.771835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d7ac4-e24f-40a2-8e48-d5bb86f45d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.772462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7ac4-e24f-40a2-8e48-d5bb86f45d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.772735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7ac4-e24f-40a2-8e48-d5bb86f45d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.773003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7ac4-e24f-40a2-8e48-d5bb86f45d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.773759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d7ac4-e24f-40a2-8e48-d5bb86f45d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.775334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d7ac4-e24f-40a2-8e48-d5bb86f45d65 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.777361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:48.796707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1077/2147] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:30:48.798068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.809155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80c30-e674-4a61-88ba-e3fed85ac17f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:48.814974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:48.815484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.815765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.816073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] PATH_INFO: `/v3/projects/35b23cba2228484f9c271598125cdf1c/users/e9afe186755145fa867d1abc088b3b79/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.834343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b23cba2228484f9c271598125cdf1c, user_id=e9afe186755145fa867d1abc088b3b79, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:48.837061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:48.853791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1071/2148] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:48 2022] PUT /identity/v3/projects/35b23cba2228484f9c271598125cdf1c/users/e9afe186755145fa867d1abc088b3b79/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:48.859020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff0c6-3c59-40e4-9c70-24d452b59b9d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:48.859394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff0c6-3c59-40e4-9c70-24d452b59b9d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:48.859675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff0c6-3c59-40e4-9c70-24d452b59b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:48.881923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-988ff0c6-3c59-40e4-9c70-24d452b59b9d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:48.883231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-988ff0c6-3c59-40e4-9c70-24d452b59b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:48.967902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1078/2149] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:48.978146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:48.980125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:49.071032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdc31f-31b7-45c2-9034-d4fd1e1981f5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:49.074982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:49.075591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:49.075861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:49.076185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:49.085484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:49.087032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:49.096583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1072/2150] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:49.824699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce9673-0c67-4574-87e3-c634c577d28b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:49.825191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce9673-0c67-4574-87e3-c634c577d28b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:49.825281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce9673-0c67-4574-87e3-c634c577d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:49.857246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-19ce9673-0c67-4574-87e3-c634c577d28b None None] MFA Rules not processed for user `e9afe186755145fa867d1abc088b3b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:49.858485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-19ce9673-0c67-4574-87e3-c634c577d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:49.929445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1079/2151] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:30:49.937903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:49.939389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:49.951148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:50.013413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb649a-32df-44f7-9abe-7ec4a03b3a7b service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:50.018514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:50.019212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:50.019572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:50.019914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:50.030079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:50.031603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:50.043047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1073/2152] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:51.472784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f911e3-9b0c-4e11-9e1c-231f018ae983 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:51.473303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f911e3-9b0c-4e11-9e1c-231f018ae983 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:51.473303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f911e3-9b0c-4e11-9e1c-231f018ae983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:51.492519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-77f911e3-9b0c-4e11-9e1c-231f018ae983 None None] MFA Rules not processed for user `e9afe186755145fa867d1abc088b3b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:51.493728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-77f911e3-9b0c-4e11-9e1c-231f018ae983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:51.500856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1080/2153] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:51.588868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:51.590855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:51.606528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a476d0e-388f-4e56-9290-8efc4663c8d8 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:51.612198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:51.612923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:51.613282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:51.613695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] PATH_INFO: `/v3/users/c9f5dd879d4f4beb88ffc6b3992275e8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:51.614841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f5dd879d4f4beb88ffc6b3992275e8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:51.616851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:51.665711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f5dd879d4f4beb88ffc6b3992275e8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:51.674237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f5dd879d4f4beb88ffc6b3992275e8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:51.675016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f5dd879d4f4beb88ffc6b3992275e8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:51.682855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f5dd879d4f4beb88ffc6b3992275e8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:51.695867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f5dd879d4f4beb88ffc6b3992275e8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:51.702255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1074/2154] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:51 2022] DELETE /identity/v3/users/c9f5dd879d4f4beb88ffc6b3992275e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:51.706614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:51.706903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:51.707179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:51.727244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:51.728737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:51.795392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1081/2155] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:51.805401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:51.806807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:51.865384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa420c-90e1-4d3c-850c-c1027bb1548e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:51.870564 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:51.871340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:51.871653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:51.871906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:51.881751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:51.883193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:51.893394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1075/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:52.177601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:52.179276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:52.220552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:52.267359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefe9d2-9b22-4a18-9085-b96a707423c9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:52.271757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:52.272409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:52.272688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:52.272961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:52.274926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:52.287189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:52.288800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:52.319438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8eed9-d9c8-44ea-89a1-b5dcf839ecba service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:52.330919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:52.332835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:52.333124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:52.333397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] PATH_INFO: `/v3/projects/3cf064bb87df4b41928537e360faf6e9` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:52.334789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf064bb87df4b41928537e360faf6e9)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:52.337035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:52.366292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:52.379834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:52.381453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:52.399672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1082/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:52.408223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf064bb87df4b41928537e360faf6e9', 'request_id': 'req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.420802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf064bb87df4b41928537e360faf6e9', 'request_id': 'req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.431980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf064bb87df4b41928537e360faf6e9', 'request_id': 'req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.445995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] The token cache is being invalidate because project 3cf064bb87df4b41928537e360faf6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:52.446427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.447115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.448930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1076/2158] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:52 2022] DELETE /identity/v3/projects/3cf064bb87df4b41928537e360faf6e9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:52.453554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:52.464161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b39a1-463e-421c-b619-fad151f1e312 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:52.547961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:52.548718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:52.549730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:52.550011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] PATH_INFO: `/v3/users/5d30a1e4ca0d4e82b9ea2096990ccfef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:52.551670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d30a1e4ca0d4e82b9ea2096990ccfef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:52.554530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:52.620754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d30a1e4ca0d4e82b9ea2096990ccfef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.631080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d30a1e4ca0d4e82b9ea2096990ccfef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.631810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d30a1e4ca0d4e82b9ea2096990ccfef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.641073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d30a1e4ca0d4e82b9ea2096990ccfef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.649861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:52.661484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d30a1e4ca0d4e82b9ea2096990ccfef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:52.668585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1083/2159] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:52 2022] DELETE /identity/v3/users/5d30a1e4ca0d4e82b9ea2096990ccfef => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:53.010598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:53.012105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:53.027542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ea4e0-0a77-46b2-a3b1-2ece5f0a1394 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:53.094016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:53.094657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:53.094964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:53.095239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] PATH_INFO: `/v3/projects/47426622812540ec901056c78cea321e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:53.096550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47426622812540ec901056c78cea321e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:53.098757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:53.150864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47426622812540ec901056c78cea321e', 'request_id': 'req-e688d6db-c7a1-421a-a3da-84833f60c42c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.160670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47426622812540ec901056c78cea321e', 'request_id': 'req-e688d6db-c7a1-421a-a3da-84833f60c42c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.167112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47426622812540ec901056c78cea321e', 'request_id': 'req-e688d6db-c7a1-421a-a3da-84833f60c42c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.179077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] The token cache is being invalidate because project 47426622812540ec901056c78cea321e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:53.179367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.180042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.181515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1077/2160] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:53 2022] DELETE /identity/v3/projects/47426622812540ec901056c78cea321e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:53.185419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:53.186899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:53.200107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051e2a1-ead0-4582-a83b-4dfc58409748 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:53.263268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:53.263967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:53.264252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:53.264518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] PATH_INFO: `/v3/users/2cafd0a63b0245a09ca0a370a22b40b7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:53.265728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cafd0a63b0245a09ca0a370a22b40b7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:53.267652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:53.320668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cafd0a63b0245a09ca0a370a22b40b7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.329367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cafd0a63b0245a09ca0a370a22b40b7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.330041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cafd0a63b0245a09ca0a370a22b40b7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.338339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cafd0a63b0245a09ca0a370a22b40b7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.352372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-adac0cb3-b7ea-47c9-bcde-bf53362df64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cafd0a63b0245a09ca0a370a22b40b7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.358849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1084/2161] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:53 2022] DELETE /identity/v3/users/2cafd0a63b0245a09ca0a370a22b40b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:53.785802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:53.788644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:53.814816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d6db-c7a1-421a-a3da-84833f60c42c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:53.874428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:53.902916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:53.903561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:53.904543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:53.904937 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] PATH_INFO: `/v3/projects/8d459139f8c3468c948f93492b4d0298` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:53.908717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d459139f8c3468c948f93492b4d0298)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:53.912462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:53.973835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d459139f8c3468c948f93492b4d0298', 'request_id': 'req-d4a47b26-c221-45cd-b46a-10fbd13b9531'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.983359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d459139f8c3468c948f93492b4d0298', 'request_id': 'req-d4a47b26-c221-45cd-b46a-10fbd13b9531'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:53.990081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d459139f8c3468c948f93492b4d0298', 'request_id': 'req-d4a47b26-c221-45cd-b46a-10fbd13b9531'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:54.003014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] The token cache is being invalidate because project 8d459139f8c3468c948f93492b4d0298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:54.003308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:54.004329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d4a47b26-c221-45cd-b46a-10fbd13b9531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:54.021664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1078/2162] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:53 2022] DELETE /identity/v3/projects/8d459139f8c3468c948f93492b4d0298 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:54.030535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.030948 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.031194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.055353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:54.056854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:54.176258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1085/2163] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:54.188931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.189225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.189647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.233373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:54.235293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:54.247036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1079/2164] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:54.251910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.263096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654d2f-e01f-4322-ab20-1cfe541a0c92 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.269885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.270523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.270802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.271068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.271717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:54.272050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.273691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.277011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:54.290078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1086/2165] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:54.296764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.306918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d408e-e127-493d-bfaf-f3eb005f40ae None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.311834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.312480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.312753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.313113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.313634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.315550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.346751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1080/2166] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:54 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:54.351052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.361390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fe47e-26d7-4d80-9416-c3d6fffe7b82 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.424191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.424827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.425103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.425373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.425998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.427902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.450353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1087/2167] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:54 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:30:54.455151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.466288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca32851-8e89-40fa-80e5-5ad374dba4ed admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.472769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.473566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.473919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.474197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.474913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.476587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.488065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1081/2168] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:54.492076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.507190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67eee25-5a17-46a7-9d2b-1f0f60c45115 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.513162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a102e-ed70-4574-9e26-4f021f45e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.513775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a102e-ed70-4574-9e26-4f021f45e8be admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.514735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a102e-ed70-4574-9e26-4f021f45e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.515030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a102e-ed70-4574-9e26-4f021f45e8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.515909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a102e-ed70-4574-9e26-4f021f45e8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.518680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a102e-ed70-4574-9e26-4f021f45e8be admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.531907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1088/2169] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:54.536277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.547113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe033ce9-88e7-46da-90fd-7cab13b6e8b9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.553480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.554278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.554560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.554880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] PATH_INFO: `/v3/projects/9bfe9f9f92694f2296d043fca174fb25/users/99086f742ef94d18a8313f7bf44989bf/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.570450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfe9f9f92694f2296d043fca174fb25, user_id=99086f742ef94d18a8313f7bf44989bf, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.573185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.587586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1082/2170] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:54 2022] PUT /identity/v3/projects/9bfe9f9f92694f2296d043fca174fb25/users/99086f742ef94d18a8313f7bf44989bf/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:54.657033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.657315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.657589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.685843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] MFA Rules not processed for user `99086f742ef94d18a8313f7bf44989bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:54.687772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:54.754495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1089/2171] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:54.766594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:54.768353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:54.831106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329caed9-2e54-4e10-8a0f-e3f00b765a7b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:54.834966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b4736-20a0-4d7a-8615-49798826f406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:54.835597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4736-20a0-4d7a-8615-49798826f406 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:54.835890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4736-20a0-4d7a-8615-49798826f406 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:54.836181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4736-20a0-4d7a-8615-49798826f406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:54.844734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b4736-20a0-4d7a-8615-49798826f406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:54.846186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b4736-20a0-4d7a-8615-49798826f406 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:54.855274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1083/2172] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:57.727353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:57.728812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:57.802623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f7c7f-c353-4077-accb-54ebc124f6f0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:57.807326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:57.807995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:57.808280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:57.808556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] PATH_INFO: `/v3/users/3153815c64dd45a2a718033129c74000` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:57.809697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3153815c64dd45a2a718033129c74000)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:57.812444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:57.817379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:57.876946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3153815c64dd45a2a718033129c74000'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:57.885516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3153815c64dd45a2a718033129c74000'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:57.886175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3153815c64dd45a2a718033129c74000'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:57.893631 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3153815c64dd45a2a718033129c74000'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:57.905820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3153815c64dd45a2a718033129c74000'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:57.911726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1090/2173] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:57 2022] DELETE /identity/v3/users/3153815c64dd45a2a718033129c74000 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:57.916381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:57.916798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:57.916963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:57.937396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:57.938615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:57.943164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:58.001456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1084/2174] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:58.010830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:58.012282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:58.068039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5b436-ac2f-4e58-9b5e-d725f5cec5e4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:58.071624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:58.072259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:58.072537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:58.072808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:58.081622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:58.083044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:58.092309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1091/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:58.432101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:58.433552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:58.445959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df250282-c3c7-410e-bea7-89a705f6686c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:58.450793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:58.451366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:58.451685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:58.451992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] PATH_INFO: `/v3/projects/c7de8aac13cf48b49d99af0fea654356` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:58.453117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7de8aac13cf48b49d99af0fea654356)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:58.455041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:58.501684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7de8aac13cf48b49d99af0fea654356', 'request_id': 'req-de894bcb-8dc3-4302-851d-5f972c0894d3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.508663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7de8aac13cf48b49d99af0fea654356', 'request_id': 'req-de894bcb-8dc3-4302-851d-5f972c0894d3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.514299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7de8aac13cf48b49d99af0fea654356', 'request_id': 'req-de894bcb-8dc3-4302-851d-5f972c0894d3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.524941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] The token cache is being invalidate because project c7de8aac13cf48b49d99af0fea654356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:58.525228 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.525847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.527315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1085/2176] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:58 2022] DELETE /identity/v3/projects/c7de8aac13cf48b49d99af0fea654356 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:58.531899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:58.541501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2b31-2a97-47b7-8c37-e7fa34730a48 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:58.602826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:58.603449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:58.603727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:58.604034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] PATH_INFO: `/v3/users/3c9eb2d8f03d4127850d7cc05a560ee0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:58.605142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9eb2d8f03d4127850d7cc05a560ee0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:58.607050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:58.634373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:58.653420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9eb2d8f03d4127850d7cc05a560ee0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.660930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9eb2d8f03d4127850d7cc05a560ee0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.661542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9eb2d8f03d4127850d7cc05a560ee0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.668299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9eb2d8f03d4127850d7cc05a560ee0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.679962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-00b6257c-ec61-4620-a052-b9ef16464540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9eb2d8f03d4127850d7cc05a560ee0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:58.685670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1092/2177] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:58 2022] DELETE /identity/v3/users/3c9eb2d8f03d4127850d7cc05a560ee0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:58.970146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:58.971661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:58.993048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de894bcb-8dc3-4302-851d-5f972c0894d3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.056710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.057371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.057653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.057940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] PATH_INFO: `/v3/projects/919f7d2799c84467ae9191cd801cfb81` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.059237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919f7d2799c84467ae9191cd801cfb81)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.062068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.105738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:59.120126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919f7d2799c84467ae9191cd801cfb81', 'request_id': 'req-25e49fd1-1872-4f6e-9544-5253818801c2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.129137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919f7d2799c84467ae9191cd801cfb81', 'request_id': 'req-25e49fd1-1872-4f6e-9544-5253818801c2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.135993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919f7d2799c84467ae9191cd801cfb81', 'request_id': 'req-25e49fd1-1872-4f6e-9544-5253818801c2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.149805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] The token cache is being invalidate because project 919f7d2799c84467ae9191cd801cfb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:30:59.150120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.150791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25e49fd1-1872-4f6e-9544-5253818801c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.152349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1086/2178] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:30:58 2022] DELETE /identity/v3/projects/919f7d2799c84467ae9191cd801cfb81 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:59.158761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274263a-25db-4cb8-b390-711e16413aff None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.159257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274263a-25db-4cb8-b390-711e16413aff None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.159347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274263a-25db-4cb8-b390-711e16413aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.180007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e274263a-25db-4cb8-b390-711e16413aff None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:59.181178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e274263a-25db-4cb8-b390-711e16413aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:59.248484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1093/2179] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:59.256753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.257040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.257317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.277883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:59.279087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:59.287617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1087/2180] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:59.291892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274263a-25db-4cb8-b390-711e16413aff None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.302166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274263a-25db-4cb8-b390-711e16413aff None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.306672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.307268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.307542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.307809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.308479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:30:59.308799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.310375 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.321628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1094/2181] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:30:59.326086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.335786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d656-d3d5-43e2-96b5-e402680ea926 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.340452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.341104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.341416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.341658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.342939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.344842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.370235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1088/2182] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:30:59 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:59.374702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.384368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16d29-ca55-4a35-87db-d194e3a745e9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.443558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.444206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.444486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.444757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.445683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.447273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.472604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1095/2183] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:30:59 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:30:59.473796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.484611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d316a9-dd3e-4770-b3d3-a34b3e3a7437 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.489125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.489720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.489994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.490264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.490901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.492491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.504435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1089/2184] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:59.508471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.518468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ec27-860e-4a88-b4d3-5fccea45c03f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.523126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f2af6-1745-4bb3-b64f-ad16b3066a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.523721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2af6-1745-4bb3-b64f-ad16b3066a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.524032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2af6-1745-4bb3-b64f-ad16b3066a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.524304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f2af6-1745-4bb3-b64f-ad16b3066a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.524946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2af6-1745-4bb3-b64f-ad16b3066a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.526526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f2af6-1745-4bb3-b64f-ad16b3066a3c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.537384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1096/2185] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:30:59.541671 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.552569 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecdc9d-2fd1-4664-84ca-766c110384da admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.557816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.558465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.558770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.559041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] PATH_INFO: `/v3/projects/eebd478989924e90b8ceb8e5238af9a8/users/9b8fcece65ec4eda8689c0182a5070c5/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.574545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebd478989924e90b8ceb8e5238af9a8, user_id=9b8fcece65ec4eda8689c0182a5070c5, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.577259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.590861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1090/2186] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:30:59 2022] PUT /identity/v3/projects/eebd478989924e90b8ceb8e5238af9a8/users/9b8fcece65ec4eda8689c0182a5070c5/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:30:59.605696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.605985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.606273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.627546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:59.635673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] MFA Rules not processed for user `9b8fcece65ec4eda8689c0182a5070c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:30:59.637446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:59.702821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1097/2187] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:30:59.737073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.738788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:30:59.797982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab988a-a592-4ea0-9a8e-5e6d1f61eece admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.801468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c7e9c-952a-4c00-8ffc-18114e791535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.802072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7e9c-952a-4c00-8ffc-18114e791535 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.802350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7e9c-952a-4c00-8ffc-18114e791535 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.802618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7e9c-952a-4c00-8ffc-18114e791535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.812560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c7e9c-952a-4c00-8ffc-18114e791535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.814506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c7e9c-952a-4c00-8ffc-18114e791535 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.823370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1091/2188] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:30:59.839670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:30:59.901298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164970f-4e3e-43e0-a01f-13deff1a22fa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:30:59.905863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:30:59.906481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:30:59.906753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:30:59.907023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] PATH_INFO: `/v3/users/9b8fcece65ec4eda8689c0182a5070c5` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:30:59.908170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8fcece65ec4eda8689c0182a5070c5)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:30:59.910066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:30:59.965814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8fcece65ec4eda8689c0182a5070c5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.973877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8fcece65ec4eda8689c0182a5070c5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.974514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8fcece65ec4eda8689c0182a5070c5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.982099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8fcece65ec4eda8689c0182a5070c5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:30:59.996567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8fcece65ec4eda8689c0182a5070c5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:00.004016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1098/2189] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:30:59 2022] DELETE /identity/v3/users/9b8fcece65ec4eda8689c0182a5070c5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:31:00.009758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.010224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.010319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.030034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:00.031239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:00.090181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1092/2190] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:00.100370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:00.102011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:00.125973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:00.166994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae44243-2a04-4837-bcfc-ac6176c72764 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:00.172384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351769ce-50dc-43a7-a4dd-5e2b37e154a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:00.173011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351769ce-50dc-43a7-a4dd-5e2b37e154a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.173296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351769ce-50dc-43a7-a4dd-5e2b37e154a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.173570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351769ce-50dc-43a7-a4dd-5e2b37e154a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.182690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351769ce-50dc-43a7-a4dd-5e2b37e154a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:00.184154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351769ce-50dc-43a7-a4dd-5e2b37e154a7 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:00.194248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1099/2191] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:00.542645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:00.544268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:00.551358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:00.557314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c78aa-9cbe-4d5f-b431-97335f2a5bee None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:00.563858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:00.564844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.565273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.565727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] PATH_INFO: `/v3/projects/eebd478989924e90b8ceb8e5238af9a8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.567179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebd478989924e90b8ceb8e5238af9a8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:00.569856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:00.629161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebd478989924e90b8ceb8e5238af9a8', 'request_id': 'req-277e331d-8c69-4896-89b2-9c85457d6b55'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:00.636723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebd478989924e90b8ceb8e5238af9a8', 'request_id': 'req-277e331d-8c69-4896-89b2-9c85457d6b55'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:00.642477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebd478989924e90b8ceb8e5238af9a8', 'request_id': 'req-277e331d-8c69-4896-89b2-9c85457d6b55'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:00.655034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] The token cache is being invalidate because project eebd478989924e90b8ceb8e5238af9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:31:00.655347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:00.656034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-277e331d-8c69-4896-89b2-9c85457d6b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:00.657744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1093/2192] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:31:00 2022] DELETE /identity/v3/projects/eebd478989924e90b8ceb8e5238af9a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:31:00.664075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.664368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.664643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.684807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:00.686063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:00.759298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1100/2193] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:00.768793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.769097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.769371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.793254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:00.794385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:00.802477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1094/2194] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:00.806859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:00.817023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbf324-84ee-4660-9caa-1a443ada50b0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:00.821923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:00.822606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.822950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.823288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.823957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:31:00.824274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:00.825861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:00.843108 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1101/2195] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:31:00.844291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:00.856903 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76eed9-f62a-40a3-b0bd-6381d296cf76 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:00.861644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:00.862240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.862517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.862788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.863425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:00.865313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:00.903549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1095/2196] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:31:00 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:31:00.905381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:00.915521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7c2c-7449-452d-a4d8-606418ff2eed admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:00.981099 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:00.981769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:00.982093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:00.982423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:00.983094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:00.985065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.009225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1102/2197] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:31:00 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:31:01.010399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.021400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1ee6f-a828-4256-8109-7b4109dc5350 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.026025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.026620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.026908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.027182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.027822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.029443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.043800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1096/2198] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:31:01.045390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.056894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee2557-be76-44d7-b355-980c7fcc74d2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.061936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.062544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.062818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.063086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.064143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.065469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.074794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.077459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:01.081395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1103/2199] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:31:01.086549 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.090906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a3372-b915-46ff-810e-d8183d87cc32 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.096762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.097529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.097777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f19b-ec52-41d3-8773-8e693ae0572e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.097883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.098214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] PATH_INFO: `/v3/users/99086f742ef94d18a8313f7bf44989bf` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.099466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99086f742ef94d18a8313f7bf44989bf)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.101508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.103704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1738-3efd-4062-bdb4-94e8799509c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.104741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1738-3efd-4062-bdb4-94e8799509c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.105372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1738-3efd-4062-bdb4-94e8799509c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.105657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1738-3efd-4062-bdb4-94e8799509c9 admin admin] PATH_INFO: `/v3/projects/b91fb028b40b457abc2e051ce2d36003/users/1ca2d6efd96f484f98c61f73eb053360/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.122581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1738-3efd-4062-bdb4-94e8799509c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91fb028b40b457abc2e051ce2d36003, user_id=1ca2d6efd96f484f98c61f73eb053360, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.126286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1738-3efd-4062-bdb4-94e8799509c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.141757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1104/2200] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:31:01 2022] PUT /identity/v3/projects/b91fb028b40b457abc2e051ce2d36003/users/1ca2d6efd96f484f98c61f73eb053360/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:31:01.152119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.152473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.152843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.155398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99086f742ef94d18a8313f7bf44989bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.162390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:01.167610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99086f742ef94d18a8313f7bf44989bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.169590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99086f742ef94d18a8313f7bf44989bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.179998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99086f742ef94d18a8313f7bf44989bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.186272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] MFA Rules not processed for user `1ca2d6efd96f484f98c61f73eb053360`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:01.188204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:01.209840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a4369f0d-9963-457f-a5ea-fa4fc2f0a911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99086f742ef94d18a8313f7bf44989bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.218506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1097/2201] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:31:01 2022] DELETE /identity/v3/users/99086f742ef94d18a8313f7bf44989bf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:31:01.222810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.223113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.223479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.243603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:01.244863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:01.258950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:01.263654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1105/2202] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:31:01.276057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.277543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:01.309987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1098/2203] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:31:01.319864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.321241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:01.336983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfaaae-0e34-4c63-bf92-0a5c147fe2fe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.377806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a594e1-7f7e-4449-96dc-0b924303ce0a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.381515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.382117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.382397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.382667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.385037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea7674-f34e-4572-9242-d5d81a17b0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.385646 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea7674-f34e-4572-9242-d5d81a17b0ae service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.385924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea7674-f34e-4572-9242-d5d81a17b0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.386195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea7674-f34e-4572-9242-d5d81a17b0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.392253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.393812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.403507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1099/2204] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:31:01.443096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea7674-f34e-4572-9242-d5d81a17b0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.444560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea7674-f34e-4572-9242-d5d81a17b0ae service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.454456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1106/2205] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:01.755755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:01.759183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:01.799071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3f287-d535-4fb1-9509-8ce2ba7186c1 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:01.804016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:01.804646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:01.804917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:01.805185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] PATH_INFO: `/v3/projects/9bfe9f9f92694f2296d043fca174fb25` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:01.806293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfe9f9f92694f2296d043fca174fb25)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:01.808212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:01.860104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfe9f9f92694f2296d043fca174fb25', 'request_id': 'req-74863aa6-f388-4e88-81a5-f97925d320f4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.870667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfe9f9f92694f2296d043fca174fb25', 'request_id': 'req-74863aa6-f388-4e88-81a5-f97925d320f4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.879031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfe9f9f92694f2296d043fca174fb25', 'request_id': 'req-74863aa6-f388-4e88-81a5-f97925d320f4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.890187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] The token cache is being invalidate because project 9bfe9f9f92694f2296d043fca174fb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:31:01.890472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.891120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-74863aa6-f388-4e88-81a5-f97925d320f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:01.892953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1100/2206] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:31:01 2022] DELETE /identity/v3/projects/9bfe9f9f92694f2296d043fca174fb25 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:31:02.853966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40994d4-4356-486f-971f-65570fc318fe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:02.854490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40994d4-4356-486f-971f-65570fc318fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:02.854490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40994d4-4356-486f-971f-65570fc318fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:02.862825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:02.875519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e40994d4-4356-486f-971f-65570fc318fe None None] MFA Rules not processed for user `1ca2d6efd96f484f98c61f73eb053360`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:02.876765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e40994d4-4356-486f-971f-65570fc318fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:02.942757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1107/2207] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:06.118920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74b18-745a-4f91-8e90-2969cf57f4aa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:06.119459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74b18-745a-4f91-8e90-2969cf57f4aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:06.119459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74b18-745a-4f91-8e90-2969cf57f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:06.139532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-42a74b18-745a-4f91-8e90-2969cf57f4aa None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:06.140741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-42a74b18-745a-4f91-8e90-2969cf57f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:06.180627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:06.201870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1101/2208] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:06.240226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40994d4-4356-486f-971f-65570fc318fe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:06.241662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e40994d4-4356-486f-971f-65570fc318fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:06.312949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40994d4-4356-486f-971f-65570fc318fe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:06.318269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:06.318862 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:06.319137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:06.319406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:06.328174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:06.329800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:06.338993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1108/2209] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:13.232810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8773f-3cfe-406b-8687-a65e9384ad09 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:13.233308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8773f-3cfe-406b-8687-a65e9384ad09 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:13.233406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8773f-3cfe-406b-8687-a65e9384ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:13.253267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-20c8773f-3cfe-406b-8687-a65e9384ad09 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:13.254464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-20c8773f-3cfe-406b-8687-a65e9384ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:13.262305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1102/2210] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:13.275889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:13.286831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38024-523e-4684-bfb5-5ad48d074ff1 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:13.292266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:13.292856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:13.293137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:13.293411 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:13.301441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:13.303043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:13.312786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1109/2211] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:22.707519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd69ed-97fa-46d7-bc75-fbc94b60f2ae None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:22.708026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd69ed-97fa-46d7-bc75-fbc94b60f2ae None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:22.708276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd69ed-97fa-46d7-bc75-fbc94b60f2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:22.732311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-75bd69ed-97fa-46d7-bc75-fbc94b60f2ae None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:22.733676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-75bd69ed-97fa-46d7-bc75-fbc94b60f2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:22.742689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1103/2212] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:22.763227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:22.765363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:22.781786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea2c8-c47d-4351-bcda-48970917675f service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:22.787307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa27fe8-d332-4130-b17d-8289ab8d085f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:22.787911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27fe8-d332-4130-b17d-8289ab8d085f service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:22.788247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27fe8-d332-4130-b17d-8289ab8d085f service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:22.788500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa27fe8-d332-4130-b17d-8289ab8d085f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:22.797608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa27fe8-d332-4130-b17d-8289ab8d085f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:22.799201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa27fe8-d332-4130-b17d-8289ab8d085f service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:22.820120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1110/2213] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:23.819975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:23.820482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:23.820594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:23.839824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] MFA Rules not processed for user `e9afe186755145fa867d1abc088b3b79`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:23.841049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:23.898112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1104/2214] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:26.842011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396616a-7786-4291-a28c-a6353369ea50 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:26.842524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396616a-7786-4291-a28c-a6353369ea50 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:26.842645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396616a-7786-4291-a28c-a6353369ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:26.863046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c396616a-7786-4291-a28c-a6353369ea50 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:26.864279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c396616a-7786-4291-a28c-a6353369ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:26.872633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1111/2215] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:26.889788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:26.902651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29718-c43d-47cb-89c5-ddbba4a2960d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:26.908064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:26.908674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:26.908957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:26.909233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:26.917454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:26.919039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:26.928691 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1105/2216] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:35.169273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c4da-d6ca-40b1-ab6e-8c2a644aed89 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:35.169826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c4da-d6ca-40b1-ab6e-8c2a644aed89 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:35.169915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c4da-d6ca-40b1-ab6e-8c2a644aed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:35.182939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=73 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:35.213255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d1a2c4da-d6ca-40b1-ab6e-8c2a644aed89 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:35.214572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d1a2c4da-d6ca-40b1-ab6e-8c2a644aed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:35.223796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1112/2217] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:35.238434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:35.249878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a26f75-f648-465d-8eee-0a2ad12cc993 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:35.258431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab008eaf-8ad8-47c8-99a2-17f211dfa0e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:35.259072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008eaf-8ad8-47c8-99a2-17f211dfa0e4 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:35.259359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008eaf-8ad8-47c8-99a2-17f211dfa0e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:35.259623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008eaf-8ad8-47c8-99a2-17f211dfa0e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:35.269999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab008eaf-8ad8-47c8-99a2-17f211dfa0e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:35.271684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab008eaf-8ad8-47c8-99a2-17f211dfa0e4 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:35.285134 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1106/2218] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:35.872981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:35.873269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:35.873545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:35.893026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] MFA Rules not processed for user `e660c9cf3dd14c489cb287a10656e940`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:35.894261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:35.960943 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1113/2219] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:41.526658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7f55d-6818-4274-8157-1b30b1e3b22a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:41.527182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7f55d-6818-4274-8157-1b30b1e3b22a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:41.527182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7f55d-6818-4274-8157-1b30b1e3b22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:41.535268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=51 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:41.547801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-04a7f55d-6818-4274-8157-1b30b1e3b22a None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:41.549025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-04a7f55d-6818-4274-8157-1b30b1e3b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:41.602363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1107/2220] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:41.644494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:41.645917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:41.718028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a33c-8da7-44a0-a915-b26342b372ed None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:41.723056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:41.723665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:41.723959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:41.724255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:41.732894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:41.734998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:41.743235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1114/2221] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:31:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:31:42.347904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eabcf-eeef-4a32-9ee5-18abedcd98cc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:42.348457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eabcf-eeef-4a32-9ee5-18abedcd98cc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:42.348941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eabcf-eeef-4a32-9ee5-18abedcd98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:42.388989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-674eabcf-eeef-4a32-9ee5-18abedcd98cc None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:42.390224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-674eabcf-eeef-4a32-9ee5-18abedcd98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:42.402110 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1108/2222] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 22 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:42.416881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:42.432497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018f3c-1bf6-4da9-829c-4273bc6898e1 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:42.440734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:42.441518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:42.441905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:42.442280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:42.453156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:42.454920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:42.467032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1115/2223] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:31:42.549474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00194-69d3-4919-a707-df153b505dc3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:42.550430 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00194-69d3-4919-a707-df153b505dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:42.550713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed00194-69d3-4919-a707-df153b505dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:42.576258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bed00194-69d3-4919-a707-df153b505dc3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:42.578334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bed00194-69d3-4919-a707-df153b505dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:42.595191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1109/2224] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:42.613664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:42.640217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08a28-7b6b-4fa2-a2a5-30c45045ad11 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:42.677496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:42.679382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:42.679874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:42.680403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:42.690869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:42.695832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:42.714421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1116/2225] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:42.874281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f0d2-ce23-402c-ace2-53d787e744f7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:42.874574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f0d2-ce23-402c-ace2-53d787e744f7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:42.874858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f0d2-ce23-402c-ace2-53d787e744f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:42.897056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-38e9f0d2-ce23-402c-ace2-53d787e744f7 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:42.898817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-38e9f0d2-ce23-402c-ace2-53d787e744f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:42.907811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1110/2226] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:42.920220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:42.934533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5f00-7333-47f6-acfd-03d34c3ff92a service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:42.939592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:42.940235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:42.940519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:42.940793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:42.951418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:42.953988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:42.963040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1117/2227] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:31:43.350212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:43.350499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:43.350773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:43.372584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:43.373896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:43.384956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1111/2228] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 22 12:31:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:43.397809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:43.408169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe28d08-5374-4ac1-8630-660c962e161c service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:43.413224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b074e3f-8474-4e36-9fd1-f560ae192b33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:43.413826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074e3f-8474-4e36-9fd1-f560ae192b33 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:43.414101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074e3f-8474-4e36-9fd1-f560ae192b33 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:43.414547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b074e3f-8474-4e36-9fd1-f560ae192b33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:43.423511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b074e3f-8474-4e36-9fd1-f560ae192b33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:43.425324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b074e3f-8474-4e36-9fd1-f560ae192b33 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:43.434395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1118/2229] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:31:45.587491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:45.589158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:45.604221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0741-7d57-420a-a290-eb5dd6a7d11e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:45.622023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:45.624798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:45.625226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:45.625507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] PATH_INFO: `/v3/users/1ca2d6efd96f484f98c61f73eb053360` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:45.626788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca2d6efd96f484f98c61f73eb053360)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:45.629025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:45.676428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca2d6efd96f484f98c61f73eb053360'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:45.684190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca2d6efd96f484f98c61f73eb053360'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:45.684867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca2d6efd96f484f98c61f73eb053360'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:45.692139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca2d6efd96f484f98c61f73eb053360'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:45.704947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca2d6efd96f484f98c61f73eb053360'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:45.711389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1112/2230] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:31:45 2022] DELETE /identity/v3/users/1ca2d6efd96f484f98c61f73eb053360 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:31:45.716705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:45.717150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:45.717392 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:45.739214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:31:45.740554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:45.775255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:45.804343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1119/2231] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:31:45.814008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:45.815485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:45.874663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3710b76-881c-4a6d-be19-628221086542 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:45.878369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75d27-d024-40db-9a55-c7d12e9ee9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:45.879007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75d27-d024-40db-9a55-c7d12e9ee9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:45.879293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75d27-d024-40db-9a55-c7d12e9ee9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:45.879570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75d27-d024-40db-9a55-c7d12e9ee9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:45.886694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:45.890279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75d27-d024-40db-9a55-c7d12e9ee9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:45.892444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75d27-d024-40db-9a55-c7d12e9ee9f1 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:45.906214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1113/2232] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:31:46.091351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:31:46.092911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:31:46.104967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c49f4-9238-4700-824e-c21e9fdf0576 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:31:46.109645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:31:46.110346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:31:46.110694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:31:46.111033 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] PATH_INFO: `/v3/projects/b91fb028b40b457abc2e051ce2d36003` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:31:46.112245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91fb028b40b457abc2e051ce2d36003)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:31:46.114254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:31:46.166433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91fb028b40b457abc2e051ce2d36003', 'request_id': 'req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:46.174819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91fb028b40b457abc2e051ce2d36003', 'request_id': 'req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:46.180947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91fb028b40b457abc2e051ce2d36003', 'request_id': 'req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:46.193712 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] The token cache is being invalidate because project b91fb028b40b457abc2e051ce2d36003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:31:46.194005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:46.196420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:31:46.198171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1120/2233] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:31:46 2022] DELETE /identity/v3/projects/b91fb028b40b457abc2e051ce2d36003 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:31:55.907189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:56.196080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:03.669540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5d00-04e0-4e87-8f67-f75e7e1391c5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:03.670082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5d00-04e0-4e87-8f67-f75e7e1391c5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:03.670209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5d00-04e0-4e87-8f67-f75e7e1391c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:03.694566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6d4e5d00-04e0-4e87-8f67-f75e7e1391c5 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:03.695947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d4e5d00-04e0-4e87-8f67-f75e7e1391c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:03.771387 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1114/2234] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:03.786893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:03.788587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:03.865585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13775a-13d7-4ec8-90a0-3dbcc7b7046a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:03.874130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034badd-4709-4c30-826b-21bf94169098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:03.874776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034badd-4709-4c30-826b-21bf94169098 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:03.875053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034badd-4709-4c30-826b-21bf94169098 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:03.875318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034badd-4709-4c30-826b-21bf94169098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:03.884024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034badd-4709-4c30-826b-21bf94169098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:03.887122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034badd-4709-4c30-826b-21bf94169098 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:03.895302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1121/2235] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:32:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 12:32:05.427827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:05.428798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:05.429236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:05.459804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] MFA Rules not processed for user `8b567d4d9fce4a0e94ef443d3ba7a0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:05.461121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:05.526330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1115/2236] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:13.893262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=32 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:15.518837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=50 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:20.269580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:20.270064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:20.270153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:20.289004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:20.290209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:20.297871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1122/2237] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 22 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:20.311032 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:20.322515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884cbd-7393-4a28-a581-c70b350ee184 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:20.327330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:20.327918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:20.328227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:20.328499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:20.336200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:20.337837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:20.345533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1116/2238] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:32:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:32:22.225125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:22.226595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:22.291960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90437a-4ede-47e0-82f7-f81415df850a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:22.297105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:22.297728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:22.298009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:22.298416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] PATH_INFO: `/v3/users/e9afe186755145fa867d1abc088b3b79` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:22.299564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9afe186755145fa867d1abc088b3b79)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:22.301508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:22.358445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9afe186755145fa867d1abc088b3b79'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.368169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9afe186755145fa867d1abc088b3b79'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.368888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9afe186755145fa867d1abc088b3b79'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.376718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9afe186755145fa867d1abc088b3b79'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.389885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec309bef-a98d-463a-99f6-17454138d3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9afe186755145fa867d1abc088b3b79'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.396001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1123/2239] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:32:22 2022] DELETE /identity/v3/users/e9afe186755145fa867d1abc088b3b79 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:32:22.567194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:22.579396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825982f-c30a-4fa5-bb22-8b878cd3bc1a service swift] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:22.637957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:22.638602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:22.638860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:22.639130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] PATH_INFO: `/v3/projects/35b23cba2228484f9c271598125cdf1c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:22.640286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b23cba2228484f9c271598125cdf1c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:22.642370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:22.689425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b23cba2228484f9c271598125cdf1c', 'request_id': 'req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.696374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b23cba2228484f9c271598125cdf1c', 'request_id': 'req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.702548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b23cba2228484f9c271598125cdf1c', 'request_id': 'req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.713524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] The token cache is being invalidate because project 35b23cba2228484f9c271598125cdf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:32:22.713820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.715131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f3c2446c-a6bb-41f3-ace0-05fdf9a7b2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:22.716678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1117/2240] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:32:22 2022] DELETE /identity/v3/projects/35b23cba2228484f9c271598125cdf1c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:32:22.721563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:22.721847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:22.722119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:22.742459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:22.743640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:22.801768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1124/2241] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:22.809624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:22.809911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:22.810189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:22.830169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:22.831381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:22.839827 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1118/2242] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:22.843963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:22.861003 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902182b5-501a-4b5d-90b0-1a84729ac335 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:22.865595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:22.866203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:22.867222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:22.867222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:22.867688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:32:22.868089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:22.869788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:22.879957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:22.884348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1125/2243] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:32:22.889197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:22.898847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30a82-02b4-45a2-9d3b-f5f6a3e28acc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:22.903695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:22.904367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:22.904650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:22.904927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:22.905557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:22.907471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:22.940233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1119/2244] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:32:22 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:32:22.941718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:22.955314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c4abe-2475-4e0d-aebb-989c8ef43448 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:23.015923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:23.016788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.017135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.017542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.018386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:23.021356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:23.043189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1126/2245] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:32:22 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:32:23.046859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:23.057201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498069e-5b42-4684-b7aa-781102cbb51b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:23.062335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:23.062942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.063205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.063478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.064144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:23.065735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:23.076209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1120/2246] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:32:23.080144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:23.090226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c005-2ee6-4193-a5f2-4ee098ff4e20 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:23.094821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e19cc-77d5-4caa-b1b2-f9b26d7d87ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:23.095407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e19cc-77d5-4caa-b1b2-f9b26d7d87ca admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.095681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e19cc-77d5-4caa-b1b2-f9b26d7d87ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.095975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e19cc-77d5-4caa-b1b2-f9b26d7d87ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.096613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e19cc-77d5-4caa-b1b2-f9b26d7d87ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:23.098181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e19cc-77d5-4caa-b1b2-f9b26d7d87ca admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:23.108620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1127/2247] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:32:23.112696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:23.123123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619d01e-e21a-48c2-ab91-825706207e44 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:23.127869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:23.128762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.129046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.129319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] PATH_INFO: `/v3/projects/06c79ab4a38f474fa71912edfdbca917/users/c4713ff48dbb4d7f9ad6b607eefd9890/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.145433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c79ab4a38f474fa71912edfdbca917, user_id=c4713ff48dbb4d7f9ad6b607eefd9890, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:23.148097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:23.160946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1121/2248] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:32:23 2022] PUT /identity/v3/projects/06c79ab4a38f474fa71912edfdbca917/users/c4713ff48dbb4d7f9ad6b607eefd9890/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:32:23.172374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f794fac-4efa-4144-9ace-edc34fd88afa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.172659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f794fac-4efa-4144-9ace-edc34fd88afa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.172932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f794fac-4efa-4144-9ace-edc34fd88afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.201907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5f794fac-4efa-4144-9ace-edc34fd88afa None None] MFA Rules not processed for user `c4713ff48dbb4d7f9ad6b607eefd9890`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:23.203148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f794fac-4efa-4144-9ace-edc34fd88afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:23.270660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1128/2249] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:23.282425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:23.284157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:23.302386 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:23.364663 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437dec8-cda0-4ad0-aaa2-dc04b36f95a8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:23.368781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:23.369391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.369665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.369930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.380680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:23.382829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:23.392999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1122/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:23.707914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfef17-ac99-4f14-a3e3-2a69729c2de3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.708318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfef17-ac99-4f14-a3e3-2a69729c2de3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.708796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfef17-ac99-4f14-a3e3-2a69729c2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.730260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5bcfef17-ac99-4f14-a3e3-2a69729c2de3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:23.731472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5bcfef17-ac99-4f14-a3e3-2a69729c2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:23.802167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1129/2251] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:23.816880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:23.819892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:23.908875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc359-4921-4ca9-9e4d-65a5fd152b32 service glance] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:23.914351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:23.914966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:23.915232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:23.915504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:23.924686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:23.926343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:23.939084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1123/2252] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:32:28.080650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7f24-15bf-4ae1-a68b-e54b9c11404d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:28.092465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7f24-15bf-4ae1-a68b-e54b9c11404d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:28.092465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf7f24-15bf-4ae1-a68b-e54b9c11404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:28.102360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9faf7f24-15bf-4ae1-a68b-e54b9c11404d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:28.103559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9faf7f24-15bf-4ae1-a68b-e54b9c11404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:28.112269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1130/2253] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:32:28.135712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:28.141257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa01e5-301f-4312-960f-9bda0d63dabe service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:28.146554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:28.147137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:28.147413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:28.147707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:28.156140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:28.157706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:28.166792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1124/2254] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:33.188874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef875c-3e6f-44bf-8c4b-a416ddf31ebf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:33.189427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef875c-3e6f-44bf-8c4b-a416ddf31ebf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:33.189532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef875c-3e6f-44bf-8c4b-a416ddf31ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:33.197288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:33.213487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-57ef875c-3e6f-44bf-8c4b-a416ddf31ebf None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:33.214846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57ef875c-3e6f-44bf-8c4b-a416ddf31ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:33.225340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1131/2255] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:33.241128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:33.242932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:33.259794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86986fd8-0cc5-47c0-94d3-7bf00ad5a3cc service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:33.268823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:33.269713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:33.270001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:33.270180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:33.280954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:33.282550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:33.292686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1125/2256] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:36.286675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686033-aaa3-4274-9dc9-fcfff2eee197 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:36.287169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686033-aaa3-4274-9dc9-fcfff2eee197 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:36.287282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686033-aaa3-4274-9dc9-fcfff2eee197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:36.307584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84686033-aaa3-4274-9dc9-fcfff2eee197 None None] MFA Rules not processed for user `379a6ec0249d49e4971b44ece81b144e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:36.309026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84686033-aaa3-4274-9dc9-fcfff2eee197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:36.364942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1132/2257] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:37.480503 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:37.482438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:37.540518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:37.556081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f703a-d149-4bb2-96b7-09ed75483cfc service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:37.561628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:37.562246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:37.562527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:37.562800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:37.564761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:37.578510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:37.580315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:37.594747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1126/2258] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:38.411101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cc9ad-8950-403e-9da3-3eeb6d0717d2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:38.411648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cc9ad-8950-403e-9da3-3eeb6d0717d2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:38.411648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cc9ad-8950-403e-9da3-3eeb6d0717d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:38.434486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5b8cc9ad-8950-403e-9da3-3eeb6d0717d2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:38.435718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5b8cc9ad-8950-403e-9da3-3eeb6d0717d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:38.444306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1133/2259] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:38.469729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:38.485824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27a8c8-724b-429d-9172-2c01c498ec01 service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:38.493040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:38.493661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:38.493944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:38.494219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:38.502857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:38.504732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:38.518973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1127/2260] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:43.659810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:43.660366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:43.660462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:43.679602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:43.680811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:43.689199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1134/2261] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Sep 22 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:43.703619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:43.715002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5b42c-fc43-46c4-bcf9-2c3c17e1f225 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:43.720602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502211-7e23-4b24-b79b-3f08720369ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:43.721223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502211-7e23-4b24-b79b-3f08720369ec service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:43.721500 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502211-7e23-4b24-b79b-3f08720369ec service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:43.721771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502211-7e23-4b24-b79b-3f08720369ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:43.730761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502211-7e23-4b24-b79b-3f08720369ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:43.732377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502211-7e23-4b24-b79b-3f08720369ec service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:43.742221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1128/2262] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:53.674262 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=33 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:53.737589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=19 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:59.071907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:59.082193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84901340-5e37-4fb0-bf44-9ed4f6deaa0d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:59.086791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:59.087422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:59.087698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:59.088000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] PATH_INFO: `/v3/users/c4713ff48dbb4d7f9ad6b607eefd9890` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:59.089132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4713ff48dbb4d7f9ad6b607eefd9890)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:59.091045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:59.137293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4713ff48dbb4d7f9ad6b607eefd9890'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.145162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4713ff48dbb4d7f9ad6b607eefd9890'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.145877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4713ff48dbb4d7f9ad6b607eefd9890'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.152926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4713ff48dbb4d7f9ad6b607eefd9890'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.165726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4713ff48dbb4d7f9ad6b607eefd9890'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.171982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1135/2263] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:32:59 2022] DELETE /identity/v3/users/c4713ff48dbb4d7f9ad6b607eefd9890 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:32:59.176636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:59.177112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:59.177208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:59.195912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:32:59.197208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:59.260684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1129/2264] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:32:59.271059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:59.272546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:59.330292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446f06f-e5a3-40ca-a3ab-4c4e3ac49341 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:59.333964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536c6f3-5b6e-4ebc-89ef-6b8b1df18c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:59.334577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536c6f3-5b6e-4ebc-89ef-6b8b1df18c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:59.334855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536c6f3-5b6e-4ebc-89ef-6b8b1df18c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:59.335124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536c6f3-5b6e-4ebc-89ef-6b8b1df18c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:59.344480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536c6f3-5b6e-4ebc-89ef-6b8b1df18c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:59.346475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536c6f3-5b6e-4ebc-89ef-6b8b1df18c1c service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:59.355878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1136/2265] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:32:59.649678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:32:59.651333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:32:59.669099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4f5d-860e-44f4-ac81-e41e9d48a9b6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:32:59.673784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:32:59.674489 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:32:59.674836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:32:59.675196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] PATH_INFO: `/v3/projects/06c79ab4a38f474fa71912edfdbca917` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:32:59.676450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c79ab4a38f474fa71912edfdbca917)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:32:59.678747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:32:59.742143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c79ab4a38f474fa71912edfdbca917', 'request_id': 'req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.756131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c79ab4a38f474fa71912edfdbca917', 'request_id': 'req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.762567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c79ab4a38f474fa71912edfdbca917', 'request_id': 'req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.775655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] The token cache is being invalidate because project 06c79ab4a38f474fa71912edfdbca917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:32:59.775993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.776881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:32:59.778613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1130/2266] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:32:59 2022] DELETE /identity/v3/projects/06c79ab4a38f474fa71912edfdbca917 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:33:04.795654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88c23-f80a-4704-82b6-6144a11fa330 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:04.796147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88c23-f80a-4704-82b6-6144a11fa330 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:04.796242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88c23-f80a-4704-82b6-6144a11fa330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:04.815546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-77f88c23-f80a-4704-82b6-6144a11fa330 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:04.816778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-77f88c23-f80a-4704-82b6-6144a11fa330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:04.872420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1137/2267] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:04.893823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:04.895220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:04.964422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27648a-a1cc-4f16-9b0a-f811632ef1d2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:04.969800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675645cd-da85-4375-b24d-584b5d8e7784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:04.970401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675645cd-da85-4375-b24d-584b5d8e7784 service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:04.970677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675645cd-da85-4375-b24d-584b5d8e7784 service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:04.970948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675645cd-da85-4375-b24d-584b5d8e7784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:04.979062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675645cd-da85-4375-b24d-584b5d8e7784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:04.980705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675645cd-da85-4375-b24d-584b5d8e7784 service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:04.989256 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1131/2268] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 12:33:14.865195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:14.985669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:19.906638 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158cce5-d349-4a96-a0ca-b7389e245e38 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:19.907231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158cce5-d349-4a96-a0ca-b7389e245e38 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:19.907231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158cce5-d349-4a96-a0ca-b7389e245e38 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:19.908602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1138/2269] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:33:19.914224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecd3c-bcfc-45ed-9b51-d51c516008f5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:19.914711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecd3c-bcfc-45ed-9b51-d51c516008f5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:19.914902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecd3c-bcfc-45ed-9b51-d51c516008f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:19.935166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d88ecd3c-bcfc-45ed-9b51-d51c516008f5 None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:19.936436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d88ecd3c-bcfc-45ed-9b51-d51c516008f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:20.005517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1132/2270] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:20.018056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158cce5-d349-4a96-a0ca-b7389e245e38 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:20.019836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8158cce5-d349-4a96-a0ca-b7389e245e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:20.077526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158cce5-d349-4a96-a0ca-b7389e245e38 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:20.081581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc63ef-9d32-44a1-8264-4022a26cccd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:20.082178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc63ef-9d32-44a1-8264-4022a26cccd3 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.082451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc63ef-9d32-44a1-8264-4022a26cccd3 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.082715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc63ef-9d32-44a1-8264-4022a26cccd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.092616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc63ef-9d32-44a1-8264-4022a26cccd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:20.094776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc63ef-9d32-44a1-8264-4022a26cccd3 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:20.105098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1139/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:33:20.184101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098fc90-4160-47d3-b0cd-0cc65880e411 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.184414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098fc90-4160-47d3-b0cd-0cc65880e411 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.184686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098fc90-4160-47d3-b0cd-0cc65880e411 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.186082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1133/2272] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:33:20.190727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a6e1-f8cf-4b4e-90b4-b9dbb1999ded None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.191009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a6e1-f8cf-4b4e-90b4-b9dbb1999ded None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.191277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a6e1-f8cf-4b4e-90b4-b9dbb1999ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.212933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7442a6e1-f8cf-4b4e-90b4-b9dbb1999ded None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:20.214114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7442a6e1-f8cf-4b4e-90b4-b9dbb1999ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:20.263949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1140/2273] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:20.276209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098fc90-4160-47d3-b0cd-0cc65880e411 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:20.277976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3098fc90-4160-47d3-b0cd-0cc65880e411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:20.291845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098fc90-4160-47d3-b0cd-0cc65880e411 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:20.295460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564d99f-d5a0-4a74-abb8-16d000d7bcf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:20.296105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564d99f-d5a0-4a74-abb8-16d000d7bcf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.296388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564d99f-d5a0-4a74-abb8-16d000d7bcf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.296660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564d99f-d5a0-4a74-abb8-16d000d7bcf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.304183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564d99f-d5a0-4a74-abb8-16d000d7bcf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:20.305618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564d99f-d5a0-4a74-abb8-16d000d7bcf4 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:20.313362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1134/2274] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:33:20.403879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c872c9-1906-4480-9aff-c0dd81c2840f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.404321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c872c9-1906-4480-9aff-c0dd81c2840f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.404701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c872c9-1906-4480-9aff-c0dd81c2840f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.406908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1141/2275] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:33:20.414931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3474-275d-43b4-bec9-1e759291769f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.415302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3474-275d-43b4-bec9-1e759291769f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.415648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb3474-275d-43b4-bec9-1e759291769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.436432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1afb3474-275d-43b4-bec9-1e759291769f None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:20.438332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1afb3474-275d-43b4-bec9-1e759291769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:20.447883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1135/2276] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:20.458865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c872c9-1906-4480-9aff-c0dd81c2840f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:20.469954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c872c9-1906-4480-9aff-c0dd81c2840f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:20.473609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:20.474209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:20.474489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:20.474762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:20.484961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:20.486381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:20.497210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1142/2277] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:33:22.820053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225425db-0e99-4f99-9278-0a7c72fd7430 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:22.820519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225425db-0e99-4f99-9278-0a7c72fd7430 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:22.820610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225425db-0e99-4f99-9278-0a7c72fd7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:22.839003 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-225425db-0e99-4f99-9278-0a7c72fd7430 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:22.840194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-225425db-0e99-4f99-9278-0a7c72fd7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:22.847135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1136/2278] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:22.859455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:22.871343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5e26-c542-491f-83b0-d46c7525cc13 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:22.876412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bbca7-b18f-4426-a112-9361699ca500 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:22.877020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bbca7-b18f-4426-a112-9361699ca500 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:22.877298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bbca7-b18f-4426-a112-9361699ca500 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:22.877573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bbca7-b18f-4426-a112-9361699ca500 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:22.885590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bbca7-b18f-4426-a112-9361699ca500 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:22.887107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bbca7-b18f-4426-a112-9361699ca500 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:22.895462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1143/2279] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:33:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:33:26.169039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1cd79-5515-48cc-8bf3-75b69e9df967 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.169562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1cd79-5515-48cc-8bf3-75b69e9df967 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.169760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1cd79-5515-48cc-8bf3-75b69e9df967 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.171337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1137/2280] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:33:26.199629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.201082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.201371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.221148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] MFA Rules not processed for user `18dcb13de7d84c88bf32e41e103f7e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:26.222758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:26.246416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1cd79-5515-48cc-8bf3-75b69e9df967 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:26.248353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b1c1cd79-5515-48cc-8bf3-75b69e9df967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:26.304884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1144/2281] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:26.318520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:26.320543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:26.344328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1cd79-5515-48cc-8bf3-75b69e9df967 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:26.345857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab08d2a-f7f2-445e-987a-0797b4722c91 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:26.350551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:26.351208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.351494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.351890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] PATH_INFO: `/v3/users/8b567d4d9fce4a0e94ef443d3ba7a0e6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.353088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b567d4d9fce4a0e94ef443d3ba7a0e6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:26.354209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:26.355019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.355128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:26.355514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.355963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.367900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:26.369850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:26.384507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1145/2282] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:33:26.412479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b567d4d9fce4a0e94ef443d3ba7a0e6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.420531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b567d4d9fce4a0e94ef443d3ba7a0e6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.421159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b567d4d9fce4a0e94ef443d3ba7a0e6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.437637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b567d4d9fce4a0e94ef443d3ba7a0e6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.443653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:26.459700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cf13f849-6128-41d4-92aa-2c0355a93abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b567d4d9fce4a0e94ef443d3ba7a0e6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.471966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1138/2283] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:33:26 2022] DELETE /identity/v3/users/8b567d4d9fce4a0e94ef443d3ba7a0e6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:33:26.650172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:26.664767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446226-b1b6-44dd-aa9d-868e00a7e15f service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:26.670967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:26.748085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:26.750117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.750572 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.751122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] PATH_INFO: `/v3/projects/10277d8078ff4abb8f4f31f626125200` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.753722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10277d8078ff4abb8f4f31f626125200)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:26.758338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:26.812473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10277d8078ff4abb8f4f31f626125200', 'request_id': 'req-1ad04519-0a3e-45ac-97d9-69482f7d77a8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.819605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10277d8078ff4abb8f4f31f626125200', 'request_id': 'req-1ad04519-0a3e-45ac-97d9-69482f7d77a8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.825035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10277d8078ff4abb8f4f31f626125200', 'request_id': 'req-1ad04519-0a3e-45ac-97d9-69482f7d77a8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.836499 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] The token cache is being invalidate because project 10277d8078ff4abb8f4f31f626125200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:33:26.836781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.837433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad04519-0a3e-45ac-97d9-69482f7d77a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:33:26.839142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1146/2284] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:33:26 2022] DELETE /identity/v3/projects/10277d8078ff4abb8f4f31f626125200 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:33:26.843830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.844140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.844411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.865168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:26.866630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:26.928048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1139/2285] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:26.936672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.936971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.937236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.957578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:26.959303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:26.968129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1147/2286] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:26.971966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:26.983892 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a97356-e7b8-492d-a701-c0b2a6502cc4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:26.988819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:26.989465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:26.989749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:26.990021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:26.990931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:33:26.991231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:26.992854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.005418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1140/2287] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:33:27.009836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:27.018930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604b207-2ad7-4217-a792-8585370ebae9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:27.024162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:27.024742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.025021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.025283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.025912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:27.027824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.062316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1148/2288] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:33:27 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:33:27.063497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:27.075237 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db8ab-7511-4c82-8599-5b78f23832eb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:27.133323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:27.134089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.134466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.134853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.135587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:27.137628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.162794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1141/2289] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:33:27 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:33:27.166771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:27.176900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85109e37-f32f-46d0-b46e-66bd6bc94659 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:27.181415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:27.182001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.182277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.182541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.183175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:27.184785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.198346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1149/2290] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:33:27.202016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:27.213889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0bb6-1b8b-4d55-a180-caad13f01055 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:27.224009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619449be-9a4c-4c85-ab21-17d03fcc33f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:27.225349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619449be-9a4c-4c85-ab21-17d03fcc33f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.225349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619449be-9a4c-4c85-ab21-17d03fcc33f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.225349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619449be-9a4c-4c85-ab21-17d03fcc33f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.225817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619449be-9a4c-4c85-ab21-17d03fcc33f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:27.227690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619449be-9a4c-4c85-ab21-17d03fcc33f8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.246567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1142/2291] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:33:27.256554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:27.267025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f69243-1dee-4843-b12e-9f07245c617c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:27.272624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:27.273376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.273723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.274059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] PATH_INFO: `/v3/projects/0ed4da3434e14e5981cfc21b8fd67844/users/1bd92246cf244a2d9347bb638b097d5f/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.290084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed4da3434e14e5981cfc21b8fd67844, user_id=1bd92246cf244a2d9347bb638b097d5f, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:27.292942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.306912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1150/2292] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:33:27 2022] PUT /identity/v3/projects/0ed4da3434e14e5981cfc21b8fd67844/users/1bd92246cf244a2d9347bb638b097d5f/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:33:27.311981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747772e5-d7b4-4591-8bb3-16c3d34fddaf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.312269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747772e5-d7b4-4591-8bb3-16c3d34fddaf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.312541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747772e5-d7b4-4591-8bb3-16c3d34fddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.331846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-747772e5-d7b4-4591-8bb3-16c3d34fddaf None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:27.333141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-747772e5-d7b4-4591-8bb3-16c3d34fddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:27.393189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:27.410775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1143/2293] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:27.425461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:27.427757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:27.473174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:27.496325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd74f-3f89-401a-8bd7-ef37d4e7ae70 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:27.499894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:27.500524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:27.500798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:27.501061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:27.512520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:27.514059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:27.538826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1151/2294] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:33:32.280625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a2657-4900-4f65-809a-25785763aad8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:32.281179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a2657-4900-4f65-809a-25785763aad8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:32.281262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a2657-4900-4f65-809a-25785763aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:32.327444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-589a2657-4900-4f65-809a-25785763aad8 None None] MFA Rules not processed for user `1bd92246cf244a2d9347bb638b097d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:32.327444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-589a2657-4900-4f65-809a-25785763aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:32.466125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1144/2295] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:32.470243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:32.487651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cae303-c321-4272-9675-73fd643ce0a7 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:32.501759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:32.501759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:32.501759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:32.501759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:32.502700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:32.502700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:32.579965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1152/2296] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:33:32 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:33:32.581199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a2657-4900-4f65-809a-25785763aad8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:32.599788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a2657-4900-4f65-809a-25785763aad8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:32.675115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:32.675890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:32.676885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:32.677121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:32.677772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:32.681259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:32.709331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1145/2297] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:33:32 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:33:32.713573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:32.724758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecefb20-baeb-42d9-b693-ee77e837c932 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:32.730604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:32.731533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:32.731797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:32.732064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:32.732957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:32.734653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:32.772774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1153/2298] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:33:32.779113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:32.806672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f53aa1-6617-4fa8-af77-d1c2b0b1fe4e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:32.816158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:32.817404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:32.817689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:32.817969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] PATH_INFO: `/v3/projects/5679c9d36aa940b799e79f1711f21b58/users/dee644667f4e4cd5bd3215f17bc6289c/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:32.879068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5679c9d36aa940b799e79f1711f21b58, user_id=dee644667f4e4cd5bd3215f17bc6289c, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:32.882543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:32.928889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:32.930359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1146/2299] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:33:32 2022] PUT /identity/v3/projects/5679c9d36aa940b799e79f1711f21b58/users/dee644667f4e4cd5bd3215f17bc6289c/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:33:32.956277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a171906-edb1-491c-a669-dca219a26f1b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:33.071906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123b232-8a09-467d-9655-6ede896bc76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:33.072867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123b232-8a09-467d-9655-6ede896bc76e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:33.073243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123b232-8a09-467d-9655-6ede896bc76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:33.073613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123b232-8a09-467d-9655-6ede896bc76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:33.074498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123b232-8a09-467d-9655-6ede896bc76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:33.076201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123b232-8a09-467d-9655-6ede896bc76e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:33.089032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1154/2300] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:33:33.092817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:33.108372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e61a-55fe-4737-bba6-c04ec856d4b2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:33.121795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:33.122482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:33.122907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:33.123241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] PATH_INFO: `/v3/projects/5679c9d36aa940b799e79f1711f21b58/users/dee644667f4e4cd5bd3215f17bc6289c/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:33.126646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5679c9d36aa940b799e79f1711f21b58, user_id=dee644667f4e4cd5bd3215f17bc6289c, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:33.130658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:33.143478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1147/2301] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:33:33 2022] PUT /identity/v3/projects/5679c9d36aa940b799e79f1711f21b58/users/dee644667f4e4cd5bd3215f17bc6289c/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:33:37.733543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe9d65-f742-4fd2-970b-6c136ad69840 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:37.734102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe9d65-f742-4fd2-970b-6c136ad69840 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:37.734102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe9d65-f742-4fd2-970b-6c136ad69840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:37.765936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cafe9d65-f742-4fd2-970b-6c136ad69840 None None] MFA Rules not processed for user `dee644667f4e4cd5bd3215f17bc6289c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:37.767186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cafe9d65-f742-4fd2-970b-6c136ad69840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:37.845597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1155/2302] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:37.859726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:37.861611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:37.906824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:37.953450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2017b44-89c3-4190-8483-c17dcf5f0f5f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:37.961209 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854933-be73-498e-9606-4db3837244f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:37.961921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854933-be73-498e-9606-4db3837244f7 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:37.962271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854933-be73-498e-9606-4db3837244f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:37.962642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854933-be73-498e-9606-4db3837244f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:38.026191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854933-be73-498e-9606-4db3837244f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:38.027831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854933-be73-498e-9606-4db3837244f7 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:38.037694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1148/2303] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:33:39.086661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:39.087191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:39.087191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:39.106879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] MFA Rules not processed for user `1bd92246cf244a2d9347bb638b097d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:39.108117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:39.116180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1156/2304] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:48.032974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=41 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:49.101238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:49.190979 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:49.191489 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:49.191651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:49.211862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:33:49.213080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:49.268439 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1149/2305] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 22 12:33:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:33:49.281355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:33:49.282761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:33:49.353162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c39d3-6dea-40c7-8db3-ad9ee1a4e0cd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:33:49.358064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a820a6-e1ff-4691-8780-bf536dd4923f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:33:49.358671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a820a6-e1ff-4691-8780-bf536dd4923f service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:33:49.358954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a820a6-e1ff-4691-8780-bf536dd4923f service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:33:49.359482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a820a6-e1ff-4691-8780-bf536dd4923f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:33:49.368373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a820a6-e1ff-4691-8780-bf536dd4923f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:33:49.370060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a820a6-e1ff-4691-8780-bf536dd4923f service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:33:49.378790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1157/2306] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:33:59.261770 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=25 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:59.375294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=32 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:13.699905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:34:13.753157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b5cc-5585-45b4-b871-5bb5305e615f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:34:13.756777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:34:13.757370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:13.757647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:13.757916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:13.759651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:13.772548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:34:13.774468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:34:13.785141 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1150/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:34:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:34:22.186555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:22.187066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:22.187066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:22.206241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] MFA Rules not processed for user `e660c9cf3dd14c489cb287a10656e940`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:34:22.207430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:22.261409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1158/2308] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:34:23.780348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=26 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:27.237477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:34:27.251029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb843a50-6471-4447-9168-265c2872ff41 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:34:27.256636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:34:27.257234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:27.257519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:27.257820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:27.259524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:27.269735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:34:27.271301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:34:27.280744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1151/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:34:32.255080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=25 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:34.274861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:34:34.287251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864eacb-da9d-44bd-b650-df91b08903e1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:34:34.293246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:34:34.293836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:34.294117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:34.294380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:34.296100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:34.353109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:34:34.354693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:34:34.363600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1159/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:34:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:34:37.276613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:44.359434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=28 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:45.050227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:34:45.061446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7895bb8-364d-4378-9557-a2f00114b5af service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:34:45.067095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:34:45.067687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:45.067994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:45.068269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:45.070502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:45.128244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:34:45.129841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:34:45.139293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1152/2311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:34:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:34:50.039134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:34:50.049129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516b1a2-e680-42e7-91ea-5e64c990f533 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:34:50.052801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:34:50.054144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:50.054424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:50.054694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:50.056546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:50.066306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:34:50.067741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3189e25-dc75-4d58-917a-ffc36a4fea74 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:34:50.077352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1160/2312] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:34:55.135188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=28 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:56.637161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:34:56.649270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d6540-c462-43ad-8457-03cb64ec686f service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:34:56.655184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:34:56.655801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:34:56.656188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:34:56.656538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:34:56.658244 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:34:56.671861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:34:56.673480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:34:56.684931 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1153/2313] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:00.073045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:00.524018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:00.524305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:00.524574 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:00.547023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] MFA Rules not processed for user `379a6ec0249d49e4971b44ece81b144e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:00.548303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:00.560408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1161/2314] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:35:01.327757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:01.340498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f5b6-1415-4cf9-a9e9-2b5c378985a6 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:01.347857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:01.348809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:01.349238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:01.349654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:01.351689 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:01.372735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:01.374655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:01.386153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1154/2315] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:01.754171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:01.755629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:01.847060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c3b07-d614-4b81-b51a-4ee1716bb88b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:01.852914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:01.853528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:01.853809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:01.854084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:01.855831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:01.868872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:01.870458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:01.880509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1162/2316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:04.987299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:05.053488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf877a-a7b2-4d44-9ef8-940237e1a8e4 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:05.058300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:05.058935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:05.059215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:05.059488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] PATH_INFO: `/v3/users/1bd92246cf244a2d9347bb638b097d5f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:05.060764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd92246cf244a2d9347bb638b097d5f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:05.062653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:05.111196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd92246cf244a2d9347bb638b097d5f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.121139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd92246cf244a2d9347bb638b097d5f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.121781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd92246cf244a2d9347bb638b097d5f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.130152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd92246cf244a2d9347bb638b097d5f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.142198 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd92246cf244a2d9347bb638b097d5f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.148221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1155/2317] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:35:04 2022] DELETE /identity/v3/users/1bd92246cf244a2d9347bb638b097d5f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:05.328985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:05.340456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c7002-a46c-4dda-b3eb-327aa9e5714e service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:05.414458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:05.415214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:05.415559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:05.415835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] PATH_INFO: `/v3/projects/0ed4da3434e14e5981cfc21b8fd67844` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:05.417086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed4da3434e14e5981cfc21b8fd67844)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:05.419045 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:05.467046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed4da3434e14e5981cfc21b8fd67844', 'request_id': 'req-0d4652c5-587f-4ab2-aabe-7926c49012aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.474739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed4da3434e14e5981cfc21b8fd67844', 'request_id': 'req-0d4652c5-587f-4ab2-aabe-7926c49012aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.482849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed4da3434e14e5981cfc21b8fd67844', 'request_id': 'req-0d4652c5-587f-4ab2-aabe-7926c49012aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.495396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] The token cache is being invalidate because project 0ed4da3434e14e5981cfc21b8fd67844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:35:05.495687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.496359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.497856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1163/2318] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:35:05 2022] DELETE /identity/v3/projects/0ed4da3434e14e5981cfc21b8fd67844 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:05.501904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:05.503265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:05.516599 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1c9cb-712c-47f4-a1b0-bbca16bd7a01 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:05.564161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:05.575023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:05.575593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:05.575876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:05.576253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] PATH_INFO: `/v3/users/dee644667f4e4cd5bd3215f17bc6289c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:05.577372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee644667f4e4cd5bd3215f17bc6289c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:05.579294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:05.625358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee644667f4e4cd5bd3215f17bc6289c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.632483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee644667f4e4cd5bd3215f17bc6289c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.633089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee644667f4e4cd5bd3215f17bc6289c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.640058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee644667f4e4cd5bd3215f17bc6289c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.652626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee644667f4e4cd5bd3215f17bc6289c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.658539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1156/2319] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:35:05 2022] DELETE /identity/v3/users/dee644667f4e4cd5bd3215f17bc6289c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:05.833694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:05.835206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:05.851147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4652c5-587f-4ab2-aabe-7926c49012aa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:05.861498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:05.911893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:05.912553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:05.912832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:05.913105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] PATH_INFO: `/v3/projects/5679c9d36aa940b799e79f1711f21b58` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:05.914251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5679c9d36aa940b799e79f1711f21b58)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:05.916180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:05.961831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5679c9d36aa940b799e79f1711f21b58', 'request_id': 'req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.968993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5679c9d36aa940b799e79f1711f21b58', 'request_id': 'req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.974595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5679c9d36aa940b799e79f1711f21b58', 'request_id': 'req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.985529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] The token cache is being invalidate because project 5679c9d36aa940b799e79f1711f21b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:35:05.985815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.986479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:05.988010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1164/2320] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:35:05 2022] DELETE /identity/v3/projects/5679c9d36aa940b799e79f1711f21b58 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:07.570836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:07.572227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:07.644190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c92e5-c3fc-48ad-a119-564f07308e43 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:07.722924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:07.723533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:07.723809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:07.724114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:07.725895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:07.731740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:07.785188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:07.786789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:07.796188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1157/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:10.889711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:10.891191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:10.907643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca5001-ec4e-42c5-a2c9-e331f8b446d7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:10.913105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:10.913741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:10.914019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:10.914292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:10.916724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:10.929146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:10.931399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a175e6-71db-4c13-a141-1db7ff4c5eef service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:10.942231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1165/2322] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:15.186864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:15.214276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67a5b9-3c2f-4c6e-8442-b6daa44592a9 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:15.220528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:15.221143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:15.221420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:15.221736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:15.223393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:15.237313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:15.238851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:15.250946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1158/2323] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:16.698384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:16.698892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:16.699007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:16.718282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] MFA Rules not processed for user `b8c15490fa2b4c16accaa316a043795b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:16.719470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:16.726288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1166/2324] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:35:25.246280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=30 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:26.713406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:53.632365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:53.633791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:53.688398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1678b6-af81-43bc-a708-f9de278f5e4e service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:53.691958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:53.692541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:53.692820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:53.693093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:53.694804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:53.757351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:53.758786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:53.769006 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1159/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:56.834739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:56.836216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:56.851053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7b5b-40bb-48f8-ac7f-4e574a298b79 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:56.855624 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:56.856287 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:56.856562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:56.856827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] PATH_INFO: `/v3/users/e660c9cf3dd14c489cb287a10656e940` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:56.857947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e660c9cf3dd14c489cb287a10656e940)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:56.859896 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:56.905226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e660c9cf3dd14c489cb287a10656e940'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:56.912437 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e660c9cf3dd14c489cb287a10656e940'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:56.913059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e660c9cf3dd14c489cb287a10656e940'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:56.920653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e660c9cf3dd14c489cb287a10656e940'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:56.932526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bacff94d-7b41-4e19-ad6d-91a9b18ebbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e660c9cf3dd14c489cb287a10656e940'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:56.938589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1167/2326] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:35:56 2022] DELETE /identity/v3/users/e660c9cf3dd14c489cb287a10656e940 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:57.116985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.130307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c93ec-b1b5-414b-8f5a-f0e0f02bf1f2 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.193682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.194303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.194575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.194849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] PATH_INFO: `/v3/projects/562fb86b22cc42a4bf096b135ba48e70` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.195975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562fb86b22cc42a4bf096b135ba48e70)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.197881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.245847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562fb86b22cc42a4bf096b135ba48e70', 'request_id': 'req-26e32795-2b5e-4cf6-aa55-c8d76b61af20'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:57.248324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:57.253373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562fb86b22cc42a4bf096b135ba48e70', 'request_id': 'req-26e32795-2b5e-4cf6-aa55-c8d76b61af20'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:57.260291 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562fb86b22cc42a4bf096b135ba48e70', 'request_id': 'req-26e32795-2b5e-4cf6-aa55-c8d76b61af20'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:57.271658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] The token cache is being invalidate because project 562fb86b22cc42a4bf096b135ba48e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:35:57.271956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:57.272619 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-26e32795-2b5e-4cf6-aa55-c8d76b61af20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:35:57.274085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1160/2327] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:35:57 2022] DELETE /identity/v3/projects/562fb86b22cc42a4bf096b135ba48e70 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:57.279766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.280101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.280376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.299599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:57.300817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:57.359136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1168/2328] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:35:57.367023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.367305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.367578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.396800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:57.398425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:57.407537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1161/2329] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:35:57.411818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.422713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee88f99-70b0-4e0d-8928-903160f799f7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.427710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.428369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.428645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.428913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.429643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:35:57.429871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.431517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.444223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1169/2330] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:35:57.449361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.458852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98285f99-b917-493b-b79f-71f1472c60f6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.463612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.465025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.465374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.465709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.466444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.468466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.499817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1162/2331] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:35:57 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:35:57.500935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.514488 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1708c3-5c18-46d9-9566-800f165cb65c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.571272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.571873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.572181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.572451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.573077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.575645 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.583540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:57.597910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1170/2332] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:35:57 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:35:57.602207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.612661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4039-4ad1-4768-bf0a-ac4c1b738f94 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.617630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.618232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.618510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.618777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.619443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.621598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.631424 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1163/2333] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:35:57.635599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.646832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e68-15e4-46b1-baae-2b2a85ae8b3c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.651389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1b097-5f8a-4bad-bd97-450597643dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.652014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1b097-5f8a-4bad-bd97-450597643dba admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.652292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1b097-5f8a-4bad-bd97-450597643dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.652559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1b097-5f8a-4bad-bd97-450597643dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.653193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1b097-5f8a-4bad-bd97-450597643dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.654762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1b097-5f8a-4bad-bd97-450597643dba admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.665163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1171/2334] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:35:57.669092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.678837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8426f-5910-47f3-9b44-a0fdf061d076 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.684085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.684720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.684996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.685264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] PATH_INFO: `/v3/projects/12bdd8ca3c0b44a2832129656e3f3175/users/cdc552569a2642d0999cbb04882758b2/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.700014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bdd8ca3c0b44a2832129656e3f3175, user_id=cdc552569a2642d0999cbb04882758b2, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.702676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.715130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1164/2335] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:35:57 2022] PUT /identity/v3/projects/12bdd8ca3c0b44a2832129656e3f3175/users/cdc552569a2642d0999cbb04882758b2/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:57.727491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f5f3e-4713-4a58-b075-4d86f79a6ef7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.727803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f5f3e-4713-4a58-b075-4d86f79a6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.728153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f5f3e-4713-4a58-b075-4d86f79a6ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.750660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7f7f5f3e-4713-4a58-b075-4d86f79a6ef7 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:57.752435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f7f5f3e-4713-4a58-b075-4d86f79a6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:57.811015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1172/2336] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:35:57.820693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:57.822463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:57.879105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ade59-e1a6-4bb2-a9c6-992f987d97ac admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:57.882749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:57.883347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:57.883627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:57.883899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:57.893567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:57.894987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:57.904305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1165/2337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:35:58.523459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.523981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.524083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.553237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] MFA Rules not processed for user `cdc552569a2642d0999cbb04882758b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:58.554454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:58.618610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1173/2338] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:35:58.624495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:58.634008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699268d-575f-40cb-bd66-cea4e1684eab service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:58.639122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:58.639715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.640117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.640289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.640919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:58.642848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:58.673543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1166/2339] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:35:58 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:35:58.674869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:58.685757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374121e-7b30-4e0f-8f33-640d9318751b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:58.745474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:58.746083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.746358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.746647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.747302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:58.749283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:58.765074 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:58.774130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1174/2340] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:35:58 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:35:58.775374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:58.786130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4b60b-215c-4282-8a83-a60dcdc30a8c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:58.790983 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:58.791587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.791870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.792407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.792847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:58.794442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:58.806024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1167/2341] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:35:58.810241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:58.819952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b56e3c-14e7-44b2-9079-dd3776a913ee admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:58.825048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:58.825683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.825958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.826226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] PATH_INFO: `/v3/projects/0c82054462104a07872b39ab39f2ef6a/users/087b357927634eb284e4c1db4ffe6da7/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.841064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c82054462104a07872b39ab39f2ef6a, user_id=087b357927634eb284e4c1db4ffe6da7, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:58.843721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:58.856565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1175/2342] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:35:58 2022] PUT /identity/v3/projects/0c82054462104a07872b39ab39f2ef6a/users/087b357927634eb284e4c1db4ffe6da7/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:58.860631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:58.871292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943e46-aada-43c1-9a08-69cfe25bf054 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:58.913292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:58.928630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c8d95-9242-4e0f-b584-ab06f16583d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:58.929227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8d95-9242-4e0f-b584-ab06f16583d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.929532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8d95-9242-4e0f-b584-ab06f16583d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.929798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8d95-9242-4e0f-b584-ab06f16583d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.930425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c8d95-9242-4e0f-b584-ab06f16583d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:58.932087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c8d95-9242-4e0f-b584-ab06f16583d2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:58.942383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1168/2343] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:35:58.946654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:35:58.957043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be586bdb-4f61-4366-b272-5c09cabbab77 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:35:58.961657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:35:58.962300 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:58.962580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:58.962854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] PATH_INFO: `/v3/projects/0c82054462104a07872b39ab39f2ef6a/users/087b357927634eb284e4c1db4ffe6da7/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:58.965733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c82054462104a07872b39ab39f2ef6a, user_id=087b357927634eb284e4c1db4ffe6da7, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:35:58.968484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:35:58.978979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1176/2344] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:35:58 2022] PUT /identity/v3/projects/0c82054462104a07872b39ab39f2ef6a/users/087b357927634eb284e4c1db4ffe6da7/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:35:59.595580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:35:59.595957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:35:59.596251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:35:59.628465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] MFA Rules not processed for user `087b357927634eb284e4c1db4ffe6da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:35:59.629806 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:35:59.715362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1169/2345] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:00.198065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:00.200777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:00.281267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffdf87-6251-4626-8222-fc2087b63502 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:00.287694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:00.288355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:00.288643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:00.288915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:00.290683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:00.303346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:00.305317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:00.316416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1177/2346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:00.767199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:00.827498 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2540f7-064d-4e93-832b-55de0c3aee81 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:00.831860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:00.832506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:00.832781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:00.833051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] PATH_INFO: `/v3/users/cdc552569a2642d0999cbb04882758b2` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:00.834160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc552569a2642d0999cbb04882758b2)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:00.836087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:00.883139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc552569a2642d0999cbb04882758b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:00.891013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc552569a2642d0999cbb04882758b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:00.891637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc552569a2642d0999cbb04882758b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:00.898656 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc552569a2642d0999cbb04882758b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:00.904412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:00.912909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc552569a2642d0999cbb04882758b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:00.919629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1170/2347] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:00 2022] DELETE /identity/v3/users/cdc552569a2642d0999cbb04882758b2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:01.091619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:01.105191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d0530-fd18-4ead-872d-4e483a57ced3 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:01.169563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:01.170199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.170480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.170750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] PATH_INFO: `/v3/projects/12bdd8ca3c0b44a2832129656e3f3175` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.171894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12bdd8ca3c0b44a2832129656e3f3175)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:01.173815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:01.224413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bdd8ca3c0b44a2832129656e3f3175', 'request_id': 'req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.228904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:01.234945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bdd8ca3c0b44a2832129656e3f3175', 'request_id': 'req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.242743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bdd8ca3c0b44a2832129656e3f3175', 'request_id': 'req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.254852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] The token cache is being invalidate because project 12bdd8ca3c0b44a2832129656e3f3175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:01.255144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.255797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.257324 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1178/2348] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:01 2022] DELETE /identity/v3/projects/12bdd8ca3c0b44a2832129656e3f3175 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:01.261376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:01.262868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:01.276213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf6f19-e9a7-459f-9c14-29b61573fe58 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:01.334886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:01.335444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.335724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.336036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] PATH_INFO: `/v3/users/087b357927634eb284e4c1db4ffe6da7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.337215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] RBAC: Authorizing `identity:delete_user(user_id=087b357927634eb284e4c1db4ffe6da7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:01.339707 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:01.388775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087b357927634eb284e4c1db4ffe6da7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.396419 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087b357927634eb284e4c1db4ffe6da7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.397167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087b357927634eb284e4c1db4ffe6da7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.405101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087b357927634eb284e4c1db4ffe6da7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.418219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fd25f234-74ef-48e2-9b7e-71b928ea824e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087b357927634eb284e4c1db4ffe6da7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.424279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1171/2349] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:01 2022] DELETE /identity/v3/users/087b357927634eb284e4c1db4ffe6da7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:01.609326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:01.611061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:01.625861 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaeff63-d243-4231-9732-1f5ba8dbe5a6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:01.689593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:01.690230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.690508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.690785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] PATH_INFO: `/v3/projects/0c82054462104a07872b39ab39f2ef6a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.691953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c82054462104a07872b39ab39f2ef6a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:01.693887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:01.743916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c82054462104a07872b39ab39f2ef6a', 'request_id': 'req-e8459a06-f0fc-4f38-827d-4a920cd43a35'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.751434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c82054462104a07872b39ab39f2ef6a', 'request_id': 'req-e8459a06-f0fc-4f38-827d-4a920cd43a35'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.758877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c82054462104a07872b39ab39f2ef6a', 'request_id': 'req-e8459a06-f0fc-4f38-827d-4a920cd43a35'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.771323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] The token cache is being invalidate because project 0c82054462104a07872b39ab39f2ef6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:01.771610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.772289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e8459a06-f0fc-4f38-827d-4a920cd43a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:01.774016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1179/2350] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:01 2022] DELETE /identity/v3/projects/0c82054462104a07872b39ab39f2ef6a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:01.779441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.779921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.780049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.799271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:01.800512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:01.862232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1172/2351] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:01.870208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.870489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.870778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.891193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:01.892604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:01.900664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1180/2352] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:01.905611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:01.916103 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440b3b-d33e-43c0-ae96-f75febee3e04 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:01.921054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:01.921653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.921929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.922311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.923071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:36:01.923374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:01.925012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:01.926632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:01.940460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1173/2353] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:36:01.942995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:01.952925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70f7f4-bd65-41f0-801c-64211a7c431c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:01.957789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:01.958398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:01.958674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:01.958940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:01.959570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:01.961558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:01.995612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1181/2354] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:01 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:01.996907 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.009182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29307b4-aba2-4fdf-8e6c-d606cabfddc3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.069252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.069863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.070144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.070418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.071048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.073020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.097882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1174/2355] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:01 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:02.099189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.109261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7a0d6-6a78-4f30-a305-4481c2bc3fb4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.114148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.114604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.114876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.115145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.116089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.117682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.128727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1182/2356] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:02.136762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.148611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea5326-18ee-482b-9f38-2f7200dde505 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.153693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dd763-c181-407d-a01a-63a578b8d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.154338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd763-c181-407d-a01a-63a578b8d65d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.154624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd763-c181-407d-a01a-63a578b8d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.154899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dd763-c181-407d-a01a-63a578b8d65d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.155545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dd763-c181-407d-a01a-63a578b8d65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.157178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dd763-c181-407d-a01a-63a578b8d65d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.169086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1175/2357] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:02.173242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.184044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dafa6-8544-4115-b660-37284f3aa712 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.188713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.189374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.189656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.189932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] PATH_INFO: `/v3/projects/73bb51d0d50e4a5f85f690291a94b5b7/users/d1c0d0f9308d45608de767120c1b6cc9/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.206483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bb51d0d50e4a5f85f690291a94b5b7, user_id=d1c0d0f9308d45608de767120c1b6cc9, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.209374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.222663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1183/2358] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:02 2022] PUT /identity/v3/projects/73bb51d0d50e4a5f85f690291a94b5b7/users/d1c0d0f9308d45608de767120c1b6cc9/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:02.234062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.234501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.234785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.266028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] MFA Rules not processed for user `d1c0d0f9308d45608de767120c1b6cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:02.267302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:02.377876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1176/2359] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:02.382417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.393028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:02.541848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b826b-80d5-40e1-b1b5-d939f7e787ff admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.564408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.564962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.567018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.567385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.568124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.570153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.601752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1184/2360] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:02 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:02.606711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.618640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30468941-12f4-49eb-b8b0-ab7e3a3c00d5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.677517 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.678131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.678411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.678686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.679320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.681297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.690989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:02.704005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1177/2361] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:02 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:02.707965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.718759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa03d1b-fdde-40d7-ab79-c0a53dbe4483 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.723534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.724167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.724453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.724732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.725378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.726966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.738358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1185/2362] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:02.742643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.753536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65543ca4-404a-4112-b4b6-cf84e3a00f0d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.758537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.759363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.759646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.759921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] PATH_INFO: `/v3/projects/44630826e53640b396bb1bef5abec6f7/users/2df7c162b12e4957983643049fb229ea/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.774632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44630826e53640b396bb1bef5abec6f7, user_id=2df7c162b12e4957983643049fb229ea, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.777918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.790882 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1178/2363] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:02 2022] PUT /identity/v3/projects/44630826e53640b396bb1bef5abec6f7/users/2df7c162b12e4957983643049fb229ea/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:02.795418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.813367 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7de40-69e5-45a4-b067-6c6eb56db5ec admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.877316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aa804-76dc-48de-971d-321bb059cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.877988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aa804-76dc-48de-971d-321bb059cc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.878337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aa804-76dc-48de-971d-321bb059cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.878676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aa804-76dc-48de-971d-321bb059cc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.879417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aa804-76dc-48de-971d-321bb059cc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.881105 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aa804-76dc-48de-971d-321bb059cc88 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.891343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1186/2364] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:02.895665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:02.906772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ef72-7c38-4e38-869f-839607b2031e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:02.911584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:02.912304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.912591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.912865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] PATH_INFO: `/v3/projects/44630826e53640b396bb1bef5abec6f7/users/2df7c162b12e4957983643049fb229ea/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.914988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44630826e53640b396bb1bef5abec6f7, user_id=2df7c162b12e4957983643049fb229ea, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:02.919119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:02.932068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1179/2365] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:02 2022] PUT /identity/v3/projects/44630826e53640b396bb1bef5abec6f7/users/2df7c162b12e4957983643049fb229ea/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:02.944075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:02.944871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:02.945145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:02.980429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] MFA Rules not processed for user `2df7c162b12e4957983643049fb229ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:02.981710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:03.058986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1187/2366] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:03.071017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:03.072802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:03.131120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47fb99-01b6-49f2-9604-40c7b1ddf738 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:03.136717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b8378-01c0-416a-aea7-946af98ddf26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:03.137329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8378-01c0-416a-aea7-946af98ddf26 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:03.137679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8378-01c0-416a-aea7-946af98ddf26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:03.137955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b8378-01c0-416a-aea7-946af98ddf26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:03.148029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b8378-01c0-416a-aea7-946af98ddf26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:03.149450 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b8378-01c0-416a-aea7-946af98ddf26 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:03.160019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1180/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:03.590460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:03.594864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:03.654913 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf3cc6-8f10-435b-96ce-102f83259799 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:03.659414 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:03.660073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:03.660370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:03.660644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] PATH_INFO: `/v3/users/d1c0d0f9308d45608de767120c1b6cc9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:03.661774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c0d0f9308d45608de767120c1b6cc9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:03.663708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:03.719088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c0d0f9308d45608de767120c1b6cc9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:03.729380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c0d0f9308d45608de767120c1b6cc9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:03.730018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c0d0f9308d45608de767120c1b6cc9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:03.743293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c0d0f9308d45608de767120c1b6cc9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:03.757670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c0d0f9308d45608de767120c1b6cc9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:03.764578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1188/2368] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:03 2022] DELETE /identity/v3/users/d1c0d0f9308d45608de767120c1b6cc9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:03.769009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:03.769304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:03.769634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:03.788396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:03.789612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:03.848322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1181/2369] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:03.859078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:03.860543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:03.923827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb077354-9e37-4e3d-860c-2fed8285eace admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:03.927344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:03.927977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:03.928256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:03.928532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:03.938271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:03.939710 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:03.950459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1189/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:04.243458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:04.247072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:04.265631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19854bb-b3f2-4e90-8918-a35d6a3c1f3a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:04.272811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:04.273957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:04.274320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:04.274711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] PATH_INFO: `/v3/projects/73bb51d0d50e4a5f85f690291a94b5b7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:04.283791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bb51d0d50e4a5f85f690291a94b5b7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:04.285809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:04.335952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bb51d0d50e4a5f85f690291a94b5b7', 'request_id': 'req-52427135-db27-42ff-b55a-840c1f07842a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.339192 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:04.346345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bb51d0d50e4a5f85f690291a94b5b7', 'request_id': 'req-52427135-db27-42ff-b55a-840c1f07842a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.353680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bb51d0d50e4a5f85f690291a94b5b7', 'request_id': 'req-52427135-db27-42ff-b55a-840c1f07842a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.365843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] The token cache is being invalidate because project 73bb51d0d50e4a5f85f690291a94b5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:04.366149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.366761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.368358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1182/2371] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:04 2022] DELETE /identity/v3/projects/73bb51d0d50e4a5f85f690291a94b5b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:04.372269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:04.381718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61851-9b4d-465f-a9c3-73567ea5058d service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:04.402996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:04.446172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:04.447018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:04.447290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:04.447576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] PATH_INFO: `/v3/users/2df7c162b12e4957983643049fb229ea` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:04.448872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df7c162b12e4957983643049fb229ea)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:04.450813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:04.498810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df7c162b12e4957983643049fb229ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.510353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df7c162b12e4957983643049fb229ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.511497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df7c162b12e4957983643049fb229ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.520239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df7c162b12e4957983643049fb229ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.542651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-339b4884-9688-41dc-9847-290b1bc64f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df7c162b12e4957983643049fb229ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.552914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1190/2372] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:04 2022] DELETE /identity/v3/users/2df7c162b12e4957983643049fb229ea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:04.835105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:04.836960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:04.869018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52427135-db27-42ff-b55a-840c1f07842a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:04.927840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:04.928541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:04.929023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:04.929284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] PATH_INFO: `/v3/projects/44630826e53640b396bb1bef5abec6f7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:04.931191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] RBAC: Authorizing `identity:delete_project(project_id=44630826e53640b396bb1bef5abec6f7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:04.933421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:04.983784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44630826e53640b396bb1bef5abec6f7', 'request_id': 'req-e277450e-9338-4629-a7e7-ce7fb08f468c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.992446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44630826e53640b396bb1bef5abec6f7', 'request_id': 'req-e277450e-9338-4629-a7e7-ce7fb08f468c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:04.998756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44630826e53640b396bb1bef5abec6f7', 'request_id': 'req-e277450e-9338-4629-a7e7-ce7fb08f468c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:05.009966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] The token cache is being invalidate because project 44630826e53640b396bb1bef5abec6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:05.010261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:05.010928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e277450e-9338-4629-a7e7-ce7fb08f468c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:05.012454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1183/2373] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:04 2022] DELETE /identity/v3/projects/44630826e53640b396bb1bef5abec6f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:05.017434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.017941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.018041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.039088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:05.040477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:05.104240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1191/2374] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:05.110074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.110362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.110645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.130861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:05.132122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:05.142093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1184/2375] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:05.146691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.161788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c074f-b2ce-4817-a34d-bf5bd53d448c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.168544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.169156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.169429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.169694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.170334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:36:05.170632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.172239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.185372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1192/2376] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:36:05.189696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.199705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac985f8b-97c3-4d53-8927-226f9ba96102 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.204914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.205577 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.205796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.206064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.206690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.208837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.240982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1185/2377] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:05.242181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.252170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0209-12a7-46b2-b7fe-010f876cb12f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.280930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:05.313189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.313795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.314073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.314341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.314965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.316923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.338088 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1193/2378] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:05.342736 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.353630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815dbcb-5fef-418b-a2b1-8d072146c91f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.364628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.365730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.365955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.366388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.367046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.368729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.379249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1186/2379] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:05.383317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.394117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342af103-faea-4191-ba31-bda82087a628 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.398768 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38143f6-49d9-4cef-8c1b-3abd51e18250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.399372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38143f6-49d9-4cef-8c1b-3abd51e18250 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.399649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38143f6-49d9-4cef-8c1b-3abd51e18250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.399919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38143f6-49d9-4cef-8c1b-3abd51e18250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.400596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38143f6-49d9-4cef-8c1b-3abd51e18250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.403083 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38143f6-49d9-4cef-8c1b-3abd51e18250 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.413501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1194/2380] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:36:05.417844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.428952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5da17d-fb55-4d57-a885-e91cf660d9cb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.433805 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9e798-a01c-45fe-9329-41e21accb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.434525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e798-a01c-45fe-9329-41e21accb8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.434871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e798-a01c-45fe-9329-41e21accb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.435230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9e798-a01c-45fe-9329-41e21accb8ca admin admin] PATH_INFO: `/v3/projects/0d0fc5e5b90043d5a6f008cbbf5ca632/users/8ae15143456043679da5dfea0655b0bf/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.450856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9e798-a01c-45fe-9329-41e21accb8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0fc5e5b90043d5a6f008cbbf5ca632, user_id=8ae15143456043679da5dfea0655b0bf, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.453672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9e798-a01c-45fe-9329-41e21accb8ca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.467990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1187/2381] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:05 2022] PUT /identity/v3/projects/0d0fc5e5b90043d5a6f008cbbf5ca632/users/8ae15143456043679da5dfea0655b0bf/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:05.479548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922818-e487-453a-a683-c306192874c1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.479909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922818-e487-453a-a683-c306192874c1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.480279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922818-e487-453a-a683-c306192874c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.510251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d7922818-e487-453a-a683-c306192874c1 None None] MFA Rules not processed for user `8ae15143456043679da5dfea0655b0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:05.512032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d7922818-e487-453a-a683-c306192874c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:05.524324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.524831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.525107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.538653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:05.545742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] MFA Rules not processed for user `1904515c3a5c4b7c8844048fd9284cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:05.547664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:05.577902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1195/2382] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:05.582339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7922818-e487-453a-a683-c306192874c1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.606909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1188/2383] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:05.652228 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7922818-e487-453a-a683-c306192874c1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.657163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.657785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.658060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.658332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.659043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.661010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.691020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1196/2384] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:05.695215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.706506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78be7a-0a65-46d1-982e-8707354cdefa None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.765898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.766649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.767031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.767425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.768203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.770219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.793280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1189/2385] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:05 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:05.797564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.808690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88151c-4a90-452e-ade5-479265118ca6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.813742 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.814412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.814695 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.814965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.815606 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.817267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.828268 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1197/2386] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:05.832293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.842407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ecad2-00be-4197-811a-fa527dc3d2a6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.847020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.847678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.847984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.848261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] PATH_INFO: `/v3/projects/8d2806a7d4574511b0d615d6b635e553/users/7423ec840e2e4319a3e07dd98a87e18f/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.863488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2806a7d4574511b0d615d6b635e553, user_id=7423ec840e2e4319a3e07dd98a87e18f, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.866467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.880465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1190/2387] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:05 2022] PUT /identity/v3/projects/8d2806a7d4574511b0d615d6b635e553/users/7423ec840e2e4319a3e07dd98a87e18f/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:05.884408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.895035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c38f86-73c7-4a9f-9af0-caff2d3bb136 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.904336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:05.952696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52692f2d-1958-419f-afd8-465e22703eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.953306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52692f2d-1958-419f-afd8-465e22703eac admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.953582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52692f2d-1958-419f-afd8-465e22703eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.953849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52692f2d-1958-419f-afd8-465e22703eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.954489 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52692f2d-1958-419f-afd8-465e22703eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.956337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52692f2d-1958-419f-afd8-465e22703eac admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:05.967781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1198/2388] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:05.972473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:05.983625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f3e3c-1e1d-4741-bca6-3c2b4accbe2f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:05.988238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:05.988890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:05.989168 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:05.989438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] PATH_INFO: `/v3/projects/8d2806a7d4574511b0d615d6b635e553/users/7423ec840e2e4319a3e07dd98a87e18f/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:05.991610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2806a7d4574511b0d615d6b635e553, user_id=7423ec840e2e4319a3e07dd98a87e18f, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:05.994270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:06.004830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1191/2389] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:05 2022] PUT /identity/v3/projects/8d2806a7d4574511b0d615d6b635e553/users/7423ec840e2e4319a3e07dd98a87e18f/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:06.015044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:06.015323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:06.015594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:06.049533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] MFA Rules not processed for user `7423ec840e2e4319a3e07dd98a87e18f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:06.050756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:06.120738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1199/2390] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:06.132483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:06.134194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:06.194996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928824e-c5b7-4c4f-9d3d-f1a548349355 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:06.199359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:06.200075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:06.200426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:06.200780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:06.211346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:06.212846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:06.223243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1192/2391] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:06.320474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:06.330451 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b567d-5406-4633-903c-6417d7b1f003 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:06.334986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516ecb8-b228-4d07-88b2-5adbd29ea095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:06.335587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ecb8-b228-4d07-88b2-5adbd29ea095 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:06.335958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ecb8-b228-4d07-88b2-5adbd29ea095 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:06.336143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ecb8-b228-4d07-88b2-5adbd29ea095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:06.397184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516ecb8-b228-4d07-88b2-5adbd29ea095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:06.398612 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516ecb8-b228-4d07-88b2-5adbd29ea095 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:06.407407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1200/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:09.185052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:09.195147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:09.253279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fdf04-9abf-4d20-8685-6044ac6b0ac1 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:09.258164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:09.258779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:09.259054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:09.259324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] PATH_INFO: `/v3/users/8ae15143456043679da5dfea0655b0bf` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:09.260499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae15143456043679da5dfea0655b0bf)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:09.262456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:09.308338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae15143456043679da5dfea0655b0bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.315257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae15143456043679da5dfea0655b0bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.315870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae15143456043679da5dfea0655b0bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.322765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae15143456043679da5dfea0655b0bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.334661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae15143456043679da5dfea0655b0bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.340514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1193/2393] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:09 2022] DELETE /identity/v3/users/8ae15143456043679da5dfea0655b0bf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:09.345047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:09.345523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:09.345634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:09.365872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:09.367071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:09.395821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:09.425758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1201/2394] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:09.436054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:09.437469 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:09.494090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de237950-c01d-48a6-ba54-5a343fda7001 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:09.498343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:09.498973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:09.499251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:09.499521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:09.508309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:09.509763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:09.519087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1194/2395] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:09.789376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:09.790429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:09.803336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce938182-d6c0-487a-b3b8-620c813e80f4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:09.808829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:09.809543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:09.809906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:09.810213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] PATH_INFO: `/v3/projects/0d0fc5e5b90043d5a6f008cbbf5ca632` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:09.811423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0fc5e5b90043d5a6f008cbbf5ca632)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:09.813407 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:09.864238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0fc5e5b90043d5a6f008cbbf5ca632', 'request_id': 'req-c8e4dca4-298c-429a-90a2-89859c8ae9f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.872485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0fc5e5b90043d5a6f008cbbf5ca632', 'request_id': 'req-c8e4dca4-298c-429a-90a2-89859c8ae9f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.877972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0fc5e5b90043d5a6f008cbbf5ca632', 'request_id': 'req-c8e4dca4-298c-429a-90a2-89859c8ae9f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.889443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] The token cache is being invalidate because project 0d0fc5e5b90043d5a6f008cbbf5ca632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:09.889729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.890381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:09.891892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1202/2396] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:09 2022] DELETE /identity/v3/projects/0d0fc5e5b90043d5a6f008cbbf5ca632 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:09.895854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:09.905452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b266-7c83-4bde-ba79-96a58c6ac7e0 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:09.931597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:09.963240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:09.963869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:09.964180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:09.964447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] PATH_INFO: `/v3/users/7423ec840e2e4319a3e07dd98a87e18f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:09.965622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7423ec840e2e4319a3e07dd98a87e18f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:09.967551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.016579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7423ec840e2e4319a3e07dd98a87e18f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.023751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7423ec840e2e4319a3e07dd98a87e18f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.024407 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7423ec840e2e4319a3e07dd98a87e18f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.031957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7423ec840e2e4319a3e07dd98a87e18f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.043914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9d214a06-d6c8-4864-af15-9dbe652f2368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7423ec840e2e4319a3e07dd98a87e18f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.049781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1195/2397] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:09 2022] DELETE /identity/v3/users/7423ec840e2e4319a3e07dd98a87e18f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:10.321848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.324019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:10.337126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4dca4-298c-429a-90a2-89859c8ae9f2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.394662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.395291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.395557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.395830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] PATH_INFO: `/v3/projects/8d2806a7d4574511b0d615d6b635e553` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.396989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2806a7d4574511b0d615d6b635e553)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.398894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.444779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2806a7d4574511b0d615d6b635e553', 'request_id': 'req-ce98d46a-ef19-4575-8949-919446f326be'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.452420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2806a7d4574511b0d615d6b635e553', 'request_id': 'req-ce98d46a-ef19-4575-8949-919446f326be'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.454444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:10.459818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2806a7d4574511b0d615d6b635e553', 'request_id': 'req-ce98d46a-ef19-4575-8949-919446f326be'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.471938 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] The token cache is being invalidate because project 8d2806a7d4574511b0d615d6b635e553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:10.472269 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.472901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce98d46a-ef19-4575-8949-919446f326be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:10.474387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1203/2398] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:10 2022] DELETE /identity/v3/projects/8d2806a7d4574511b0d615d6b635e553 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:10.484368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.484905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.484905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.505155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:10.506335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:10.564541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1196/2399] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:10.572169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.572453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.572726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.592588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:10.593810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:10.601558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1204/2400] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:10.605636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.615109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3bacb-3922-4475-a12d-a8e2414c66ef None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.620415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.621005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.621289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.621558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.622186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:36:10.622487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.624122 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.636219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1197/2401] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:36:10.640297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.649424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9b563-515a-40eb-b8de-6d748d9efa4c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.654028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.654614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.654891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.655160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.655792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.657751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.685983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1205/2402] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:10 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:10.690170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.700151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ff25-1fc6-4c24-ac94-01b250755b9b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.731797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:10.758772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.759376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.759654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.759923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.760601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.762499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.782018 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1198/2403] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:10 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:10.786095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.796987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d8582-cf3d-4080-8972-66b196be07ed admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.801564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.802159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.802466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.802743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.803386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.805142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.815619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1206/2404] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:10.819365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.829071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a355e-8751-4cdd-b446-65b53c0d1344 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.833672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd402fa-164a-4c53-a99d-decb28398522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.834249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd402fa-164a-4c53-a99d-decb28398522 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.834525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd402fa-164a-4c53-a99d-decb28398522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.834791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd402fa-164a-4c53-a99d-decb28398522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.835415 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd402fa-164a-4c53-a99d-decb28398522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.837024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd402fa-164a-4c53-a99d-decb28398522 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.847264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1199/2405] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:10.851147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:10.861877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9ae99-2dce-4088-a507-3dc1deb56eb8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:10.866750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:10.867399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.867681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.867974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] PATH_INFO: `/v3/projects/543f5bd838a74dff919b322b23943ff3/users/8b4242d17c9b4defb1947b9e6c49182e/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.883548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543f5bd838a74dff919b322b23943ff3, user_id=8b4242d17c9b4defb1947b9e6c49182e, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:10.886235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:10.899533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1207/2406] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:10 2022] PUT /identity/v3/projects/543f5bd838a74dff919b322b23943ff3/users/8b4242d17c9b4defb1947b9e6c49182e/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:10.910702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:10.910991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:10.911272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:10.939717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] MFA Rules not processed for user `8b4242d17c9b4defb1947b9e6c49182e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:10.940971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:11.008208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1200/2407] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:11.012703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.074523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972b8d-6860-496f-9d08-d4d1551d3921 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.079217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.079821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.080140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.080416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.081054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.082985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.110399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1208/2408] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:11 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:11.114638 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.125410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50dea8-e283-47d9-88e4-3a83a9f1e2bd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.180329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.180861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.181140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.181413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.182074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.184359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.206145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1201/2409] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:11 2022] POST /identity/v3/users => generated 307 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:11.210345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.221128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421bf50-1812-4f09-9508-1fa88e59c797 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.225981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.226567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.226849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.227124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.228144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.230634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.242662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1209/2410] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:11.246665 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.256487 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c793957-76bf-4927-9da4-70cea427a145 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.261474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.262172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.262453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.262735 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] PATH_INFO: `/v3/projects/8e910296a91a47d38dc563d64430087e/users/9a44a4c0dd664bf68dbc7d322580ca13/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.277681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e910296a91a47d38dc563d64430087e, user_id=9a44a4c0dd664bf68dbc7d322580ca13, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.280420 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.293416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1202/2411] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:11 2022] PUT /identity/v3/projects/8e910296a91a47d38dc563d64430087e/users/9a44a4c0dd664bf68dbc7d322580ca13/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:11.297420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.307216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a1dfa-7efd-4258-8bc1-aee3208a1917 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.356792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:11.363167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd017d-a6d0-49af-a9da-c9cb364b5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.364780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd017d-a6d0-49af-a9da-c9cb364b5d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.365102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd017d-a6d0-49af-a9da-c9cb364b5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.365456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd017d-a6d0-49af-a9da-c9cb364b5d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.366679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd017d-a6d0-49af-a9da-c9cb364b5d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.369220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd017d-a6d0-49af-a9da-c9cb364b5d8a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.379617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1210/2412] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:11.383695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.394268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b4f9f-e455-490a-9cce-ff4110a9362a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.398792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.399433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.399710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.400129 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] PATH_INFO: `/v3/projects/8e910296a91a47d38dc563d64430087e/users/9a44a4c0dd664bf68dbc7d322580ca13/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.402648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e910296a91a47d38dc563d64430087e, user_id=9a44a4c0dd664bf68dbc7d322580ca13, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.405299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.408287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:11.416191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1203/2413] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:11 2022] PUT /identity/v3/projects/8e910296a91a47d38dc563d64430087e/users/9a44a4c0dd664bf68dbc7d322580ca13/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:11.426090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.426562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.426683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.454312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] MFA Rules not processed for user `9a44a4c0dd664bf68dbc7d322580ca13`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:11.455476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:11.524976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1211/2414] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:11 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:11.536326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.538027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:11.593919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ab403-06bb-4e64-91b6-46c67e474cde admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.597449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.598038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.598315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.598587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.607954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.609470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.619049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1204/2415] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:11.693134 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:11.703110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41e5c6-ad61-4006-a651-3d05a4e0e269 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:11.706664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e7c5c-5838-4ca0-85e2-e74c24cab8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:11.707194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e7c5c-5838-4ca0-85e2-e74c24cab8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:11.707466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e7c5c-5838-4ca0-85e2-e74c24cab8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:11.707732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e7c5c-5838-4ca0-85e2-e74c24cab8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:11.774627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e7c5c-5838-4ca0-85e2-e74c24cab8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:11.776170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e7c5c-5838-4ca0-85e2-e74c24cab8a1 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:11.785550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1212/2416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:15.869443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:15.932492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf1745-1b46-4389-8755-1a2112d5339f service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:15.937072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:15.937708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:15.937985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:15.938258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] PATH_INFO: `/v3/users/8b4242d17c9b4defb1947b9e6c49182e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:15.939382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4242d17c9b4defb1947b9e6c49182e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:15.941338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:15.987878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4242d17c9b4defb1947b9e6c49182e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:15.996922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4242d17c9b4defb1947b9e6c49182e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:15.997551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4242d17c9b4defb1947b9e6c49182e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.005158 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4242d17c9b4defb1947b9e6c49182e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.024186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4242d17c9b4defb1947b9e6c49182e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.034990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1205/2417] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:15 2022] DELETE /identity/v3/users/8b4242d17c9b4defb1947b9e6c49182e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:16.039551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:16.040041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:16.040157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:16.059139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:16.060400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:16.117879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1213/2418] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:16.127458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:16.128899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:16.149462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:16.187512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aac20-416e-4cca-b4a2-45d2e2902686 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:16.191073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:16.191667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:16.191966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:16.192670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:16.202616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:16.204084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:16.213348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1206/2419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:36:16.473154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:16.474670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:16.490405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af874-ff54-4dde-bb7a-5101f926af58 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:16.497017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:16.497884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:16.498307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:16.498618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] PATH_INFO: `/v3/projects/543f5bd838a74dff919b322b23943ff3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:16.500032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=543f5bd838a74dff919b322b23943ff3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:16.502163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:16.514330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:16.550864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543f5bd838a74dff919b322b23943ff3', 'request_id': 'req-a9a1bcec-2178-435a-934a-8eff2b8a7aef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.558524 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543f5bd838a74dff919b322b23943ff3', 'request_id': 'req-a9a1bcec-2178-435a-934a-8eff2b8a7aef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.564650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543f5bd838a74dff919b322b23943ff3', 'request_id': 'req-a9a1bcec-2178-435a-934a-8eff2b8a7aef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.575427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] The token cache is being invalidate because project 543f5bd838a74dff919b322b23943ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:16.575708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.576344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.577803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1214/2420] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:16 2022] DELETE /identity/v3/projects/543f5bd838a74dff919b322b23943ff3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:16.581734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:16.591864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663b003-b055-4740-bebb-fa5f9748f66a service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:16.650649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:16.651912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:16.652225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:16.652516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] PATH_INFO: `/v3/users/9a44a4c0dd664bf68dbc7d322580ca13` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:16.653636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a44a4c0dd664bf68dbc7d322580ca13)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:16.655550 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:16.698760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a44a4c0dd664bf68dbc7d322580ca13'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.706121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a44a4c0dd664bf68dbc7d322580ca13'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.706761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a44a4c0dd664bf68dbc7d322580ca13'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.714164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a44a4c0dd664bf68dbc7d322580ca13'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.726946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bda5453e-2026-4c77-be8e-67d96ccfa237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a44a4c0dd664bf68dbc7d322580ca13'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:16.733133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1207/2421] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:16 2022] DELETE /identity/v3/users/9a44a4c0dd664bf68dbc7d322580ca13 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:17.003665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.005152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:17.020970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1bcec-2178-435a-934a-8eff2b8a7aef admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.079758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.080481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.080725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.080995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] PATH_INFO: `/v3/projects/8e910296a91a47d38dc563d64430087e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.082750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e910296a91a47d38dc563d64430087e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.084737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.131219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e910296a91a47d38dc563d64430087e', 'request_id': 'req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:17.139907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e910296a91a47d38dc563d64430087e', 'request_id': 'req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:17.145454 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e910296a91a47d38dc563d64430087e', 'request_id': 'req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:17.157079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] The token cache is being invalidate because project 8e910296a91a47d38dc563d64430087e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:17.157363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:17.158009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8eabe7d-c99f-440a-bdff-5cdfa1a6b10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:17.159533 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1215/2422] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:17 2022] DELETE /identity/v3/projects/8e910296a91a47d38dc563d64430087e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:17.165406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.165814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.166115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.186887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:17.188850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:17.235624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:17.277289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1208/2423] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:17.286227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.286509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.286790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.306623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:17.308444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:17.318544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1216/2424] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:17.322600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.332922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717d0ab-718d-4819-aa8c-421f4cf155f8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.338241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.338885 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.339160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.339428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.340104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:36:17.340404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.342221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.356108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1209/2425] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:36:17.359186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.370571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1507-3a9a-4b60-ba13-447ce9cf4fdb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.375596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.376319 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.376697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.376989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.377639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.379699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.410239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1217/2426] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:17.414901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.426596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13bc2-10b7-46a4-8fc9-f422fb2561cc admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.484704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.485311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.485586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.485889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.486547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.488451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.516668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1210/2427] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:17.521023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.526721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:17.532097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b911d4-e4d7-4e6e-beab-e782457632b8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.539675 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.540436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.540909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.542199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.542990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.544731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.555401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1218/2428] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:17.560274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.570795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e04d-c6d0-4f35-b59b-04310d3f6ce7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.575965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecadbd-2103-48f8-901e-8e503ec8e5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.576328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecadbd-2103-48f8-901e-8e503ec8e5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.576609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecadbd-2103-48f8-901e-8e503ec8e5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.576883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecadbd-2103-48f8-901e-8e503ec8e5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.577533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecadbd-2103-48f8-901e-8e503ec8e5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.579121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecadbd-2103-48f8-901e-8e503ec8e5a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.589919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1211/2429] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:17.594281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.605292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1a098-93c4-4ab7-bb64-4db8eccb7b6f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.610365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.611059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.611347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.611629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] PATH_INFO: `/v3/projects/9ebf14bebd164468b293ed315a064b3d/users/bc128f7b7d364c8f8c5f481862652854/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.627357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebf14bebd164468b293ed315a064b3d, user_id=bc128f7b7d364c8f8c5f481862652854, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.630072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.644188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1219/2430] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:17 2022] PUT /identity/v3/projects/9ebf14bebd164468b293ed315a064b3d/users/bc128f7b7d364c8f8c5f481862652854/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:17.654601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.654889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.655169 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.685030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] MFA Rules not processed for user `bc128f7b7d364c8f8c5f481862652854`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:17.686464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:17.752840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1212/2431] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:17.757444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.819423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc037ab5-a3e1-4b25-ae2a-95abb4105b3f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.824089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.824704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.824988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.825264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.825919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.827835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.857018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1220/2432] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:17.861024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.875797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3773-7cd0-40c4-8b41-7b0a41594a2a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.910167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:17.935824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.936465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.936744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.937024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.937684 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.940199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:17.962083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1213/2433] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:17 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:17.967441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:17.978853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495d26-c33a-41d7-93f8-b1346dd137c1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:17.984120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:17.984715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:17.984986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:17.985246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:17.985881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:17.987456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:18.001663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1221/2434] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:18.002924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:18.022766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a2acf-0412-4599-9c08-df563899c9e5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:18.028120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:18.028792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.029073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.029351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] PATH_INFO: `/v3/projects/63cd9703ebd94e32ae8f6e15c2d666bd/users/138f4b00d1094d64b3cd5220da7a526b/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:18.045320 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cd9703ebd94e32ae8f6e15c2d666bd, user_id=138f4b00d1094d64b3cd5220da7a526b, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:18.047996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:18.062774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1214/2435] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:18 2022] PUT /identity/v3/projects/63cd9703ebd94e32ae8f6e15c2d666bd/users/138f4b00d1094d64b3cd5220da7a526b/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:18.066809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:18.077092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0b875-e0e0-44a7-a452-a975d97c5432 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:18.133497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d558-c8e9-4582-a05d-1d874cb393ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:18.134154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d558-c8e9-4582-a05d-1d874cb393ec admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.134376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d558-c8e9-4582-a05d-1d874cb393ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.134649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d558-c8e9-4582-a05d-1d874cb393ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:18.135982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d558-c8e9-4582-a05d-1d874cb393ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:18.137593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d558-c8e9-4582-a05d-1d874cb393ec admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:18.147699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1222/2436] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:36:18.152403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:18.162634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99c083-33ad-449d-a2a6-394bce96d4fb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:18.167592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:18.168276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.168557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.168833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] PATH_INFO: `/v3/projects/63cd9703ebd94e32ae8f6e15c2d666bd/users/138f4b00d1094d64b3cd5220da7a526b/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:18.170761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cd9703ebd94e32ae8f6e15c2d666bd, user_id=138f4b00d1094d64b3cd5220da7a526b, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:18.173449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:18.183914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1215/2437] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:18 2022] PUT /identity/v3/projects/63cd9703ebd94e32ae8f6e15c2d666bd/users/138f4b00d1094d64b3cd5220da7a526b/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:18.197190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.197190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.197190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:18.231014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] MFA Rules not processed for user `138f4b00d1094d64b3cd5220da7a526b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:18.232334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:18.260152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:18.325914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1223/2438] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:18.338265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:18.340253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:18.411423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa371-84dd-4458-9731-0880757f7e68 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:18.417911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:18.418532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.418810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.419119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:18.430425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:18.431912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:18.445819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1216/2439] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:18.541357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:18.551131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2a309-64f8-4025-9e0d-3d680ad638d5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:18.554948 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629ef37-5a4e-4934-9d9d-e9d7885a184b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:18.555550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ef37-5a4e-4934-9d9d-e9d7885a184b service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.555827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ef37-5a4e-4934-9d9d-e9d7885a184b service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.556129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ef37-5a4e-4934-9d9d-e9d7885a184b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:18.623418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629ef37-5a4e-4934-9d9d-e9d7885a184b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:18.625078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629ef37-5a4e-4934-9d9d-e9d7885a184b service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:18.634785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1224/2440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:18.918818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:18.994083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d71e7-ef89-4db6-a2d1-367037e5f01c service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:18.998717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:18.999346 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:18.999626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:18.999898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] PATH_INFO: `/v3/users/bc128f7b7d364c8f8c5f481862652854` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:19.001058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc128f7b7d364c8f8c5f481862652854)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:19.002992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:19.039566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:19.053858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc128f7b7d364c8f8c5f481862652854'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.061604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc128f7b7d364c8f8c5f481862652854'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.062229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc128f7b7d364c8f8c5f481862652854'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.070353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc128f7b7d364c8f8c5f481862652854'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.083717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc128f7b7d364c8f8c5f481862652854'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.090554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1217/2441] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:18 2022] DELETE /identity/v3/users/bc128f7b7d364c8f8c5f481862652854 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:19.095050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:19.095340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:19.095669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:19.115514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:19.117090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:19.178525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1225/2442] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:19.188220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:19.189652 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:19.260796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bc8b8-3f4d-428a-82e5-fff42d5648e9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:19.264694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:19.265466 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:19.265756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:19.266033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:19.281196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:19.282670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:19.293007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1218/2443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:19.586821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:19.588492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:19.604257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d0df-41e5-42d9-a4a1-abdf2571e36b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:19.611958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:19.613182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:19.613690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:19.614191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] PATH_INFO: `/v3/projects/9ebf14bebd164468b293ed315a064b3d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:19.616250 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebf14bebd164468b293ed315a064b3d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:19.618939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:19.667024 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebf14bebd164468b293ed315a064b3d', 'request_id': 'req-350805d9-35e5-4c48-bea8-0233487f3ea9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.673980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebf14bebd164468b293ed315a064b3d', 'request_id': 'req-350805d9-35e5-4c48-bea8-0233487f3ea9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.675158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:19.680957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebf14bebd164468b293ed315a064b3d', 'request_id': 'req-350805d9-35e5-4c48-bea8-0233487f3ea9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.693307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] The token cache is being invalidate because project 9ebf14bebd164468b293ed315a064b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:19.693593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.694216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.695689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1226/2444] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:19 2022] DELETE /identity/v3/projects/9ebf14bebd164468b293ed315a064b3d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:19.699709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:19.709319 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7513b4-2af7-418d-868e-dd808311b30c service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:19.764889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:19.765524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:19.765802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:19.766075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] PATH_INFO: `/v3/users/138f4b00d1094d64b3cd5220da7a526b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:19.767360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138f4b00d1094d64b3cd5220da7a526b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:19.769341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:19.814086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138f4b00d1094d64b3cd5220da7a526b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.821335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138f4b00d1094d64b3cd5220da7a526b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.821965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138f4b00d1094d64b3cd5220da7a526b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.823155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:19.831123 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138f4b00d1094d64b3cd5220da7a526b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.843833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fa405bda-5f3c-4b1b-a5f6-35bc49ef78b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138f4b00d1094d64b3cd5220da7a526b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:19.849622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1219/2445] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:19 2022] DELETE /identity/v3/users/138f4b00d1094d64b3cd5220da7a526b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:20.122072 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.123647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:20.137062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350805d9-35e5-4c48-bea8-0233487f3ea9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.211251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.211967 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.212196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.212473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] PATH_INFO: `/v3/projects/63cd9703ebd94e32ae8f6e15c2d666bd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.214210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cd9703ebd94e32ae8f6e15c2d666bd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.217777 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.265506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cd9703ebd94e32ae8f6e15c2d666bd', 'request_id': 'req-1112094c-2a7b-43e9-b4c0-12d0230be232'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:20.272009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cd9703ebd94e32ae8f6e15c2d666bd', 'request_id': 'req-1112094c-2a7b-43e9-b4c0-12d0230be232'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:20.278244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cd9703ebd94e32ae8f6e15c2d666bd', 'request_id': 'req-1112094c-2a7b-43e9-b4c0-12d0230be232'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:20.289056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] The token cache is being invalidate because project 63cd9703ebd94e32ae8f6e15c2d666bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:20.289341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:20.289970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1112094c-2a7b-43e9-b4c0-12d0230be232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:20.292338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1227/2446] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:20 2022] DELETE /identity/v3/projects/63cd9703ebd94e32ae8f6e15c2d666bd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:20.297133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.297648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.298095 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.317313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:20.318527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:20.377778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1220/2447] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:20.439562 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.439845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.440196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.460282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:20.461522 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:20.470111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1228/2448] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:20.474755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.492087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b9d5-17bc-400a-a92a-078750acc124 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.497293 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.498381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.498900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.499344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.500045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:36:20.500357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.501976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.514413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1221/2449] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:36:20.518889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.528628 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8835e-5480-4c84-8ca0-fba6f8891c19 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.533278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.533871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.534150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.534427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.535047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.537005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.563785 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1229/2450] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:20 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:20.568333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.578611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838017b-5f81-461a-bc22-ee3498312683 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.634720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.635730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.636034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.636309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.636921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.638815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.659609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1222/2451] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:20 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:20.663891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.674320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae82859-3c3e-4707-b114-cab8263b288c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.678799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.679387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.679661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.679950 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.680581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.682148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.691897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1230/2452] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:36:20.695644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.705888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea195e0-9110-4b90-b0c5-ef09cadcabf1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.710489 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ae8f8-60ab-4fb3-9d0c-e4ba1b935c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.711073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae8f8-60ab-4fb3-9d0c-e4ba1b935c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.711349 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae8f8-60ab-4fb3-9d0c-e4ba1b935c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.711618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ae8f8-60ab-4fb3-9d0c-e4ba1b935c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.712304 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ae8f8-60ab-4fb3-9d0c-e4ba1b935c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.714421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ae8f8-60ab-4fb3-9d0c-e4ba1b935c2c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.724703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1223/2453] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:36:20.728596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.738226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00c3b-d3ba-4cb9-a26e-bbdbac82dec8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.742966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.743608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.743884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.744188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] PATH_INFO: `/v3/projects/6b9399d6a5c94c6287698f5641a3f919/users/6817a7ceb29a40ff8bf76b78c50e3112/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.759006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9399d6a5c94c6287698f5641a3f919, user_id=6817a7ceb29a40ff8bf76b78c50e3112, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.762198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.776794 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1231/2454] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:20 2022] PUT /identity/v3/projects/6b9399d6a5c94c6287698f5641a3f919/users/6817a7ceb29a40ff8bf76b78c50e3112/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:20.781682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e26a82-8c9b-4835-8615-3c04178972af None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.781967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e26a82-8c9b-4835-8615-3c04178972af None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.782267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e26a82-8c9b-4835-8615-3c04178972af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.800616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f6e26a82-8c9b-4835-8615-3c04178972af None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:20.801789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f6e26a82-8c9b-4835-8615-3c04178972af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:20.835117 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:20.863034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1224/2455] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:20.872891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:20.874826 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:20.888048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:20.934070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35517757-bd2f-4821-a4da-395ef73bc345 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:20.937995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:20.938623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:20.938897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:20.939170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:20.948224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:20.949632 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:20.958648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1232/2456] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:21.563104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:21.563620 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:21.563733 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:21.592495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] MFA Rules not processed for user `6817a7ceb29a40ff8bf76b78c50e3112`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:21.593719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:21.663567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1225/2457] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:21.668677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:21.678821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abc0e6-1098-4a62-a2ea-d5bedfac9280 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:21.683615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:21.684332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:21.684682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:21.685020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:21.685854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:21.687890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:21.719773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1233/2458] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:21 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:21.721224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:21.733820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ebb92-0990-401d-a223-dabb9be4530b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:21.794384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:21.795004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:21.795287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:21.795562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:21.796230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:21.798216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:21.820916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1226/2459] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:21 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:21.824959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:21.835111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b2d55-61ec-4a90-80c5-30f9741a781d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:21.840357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:21.840961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:21.841235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:21.841506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:21.842283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:21.843867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:21.855244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1234/2460] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:21.859453 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:21.870476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04647d-809c-46af-a4c3-c46852fbc12d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:21.875236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:21.875890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:21.876205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:21.876483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] PATH_INFO: `/v3/projects/d9821f4376694da3a1977c2c5434be63/users/40690d61258c48c68544e1c3cb4b28c1/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:21.891896 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9821f4376694da3a1977c2c5434be63, user_id=40690d61258c48c68544e1c3cb4b28c1, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:21.894642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:21.907472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1227/2461] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:21 2022] PUT /identity/v3/projects/d9821f4376694da3a1977c2c5434be63/users/40690d61258c48c68544e1c3cb4b28c1/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:21.911434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:21.921396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561856de-3a98-4c4e-8f74-ff3bc2be8902 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:21.977991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd36c-4b68-4158-9ffa-258717cdd500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:21.978531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd36c-4b68-4158-9ffa-258717cdd500 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:21.978811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd36c-4b68-4158-9ffa-258717cdd500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:21.979106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd36c-4b68-4158-9ffa-258717cdd500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:21.979764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd36c-4b68-4158-9ffa-258717cdd500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:21.981377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd36c-4b68-4158-9ffa-258717cdd500 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:21.991245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1235/2462] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:21.995467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:22.005641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b54fdb-1920-4a5e-9c72-2c5c32407ea9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:22.011037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b61fcf-f5b1-4dcf-a972-405ccbe2ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:22.011669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b61fcf-f5b1-4dcf-a972-405ccbe2ae93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:22.011965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b61fcf-f5b1-4dcf-a972-405ccbe2ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:22.012248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b61fcf-f5b1-4dcf-a972-405ccbe2ae93 admin admin] PATH_INFO: `/v3/projects/d9821f4376694da3a1977c2c5434be63/users/40690d61258c48c68544e1c3cb4b28c1/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:22.014147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b61fcf-f5b1-4dcf-a972-405ccbe2ae93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9821f4376694da3a1977c2c5434be63, user_id=40690d61258c48c68544e1c3cb4b28c1, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:22.016782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b61fcf-f5b1-4dcf-a972-405ccbe2ae93 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:22.028481 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1228/2463] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:21 2022] PUT /identity/v3/projects/d9821f4376694da3a1977c2c5434be63/users/40690d61258c48c68544e1c3cb4b28c1/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:22.629765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:22.630136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:22.630478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:22.662756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] MFA Rules not processed for user `40690d61258c48c68544e1c3cb4b28c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:22.664877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:22.736211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1236/2464] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:22.747461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:22.748163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:22.748163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:22.767057 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] MFA Rules not processed for user `6817a7ceb29a40ff8bf76b78c50e3112`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:22.768318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:22.780952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:22.832213 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1229/2465] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:22.843866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:22.845385 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:22.850442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:22.921412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad3fc-f21d-4102-8b8b-d38f9068e7a4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:22.926786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91215a-6c63-4492-a9fa-e86c4feb7137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:22.927409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91215a-6c63-4492-a9fa-e86c4feb7137 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:22.927692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91215a-6c63-4492-a9fa-e86c4feb7137 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:22.927984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91215a-6c63-4492-a9fa-e86c4feb7137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:22.936058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91215a-6c63-4492-a9fa-e86c4feb7137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:22.937620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91215a-6c63-4492-a9fa-e86c4feb7137 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:22.946161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1237/2466] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:32.819814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=16 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:32.942263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=33 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:36.986985 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:36.988464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:37.044478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7cd0-eb2e-4774-92ce-28a7266a2a87 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:37.048071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:37.048669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:37.048950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:37.049223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:37.058674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:37.060139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:37.069391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1230/2467] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:36:47.065308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=26 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:55.157650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:55.158178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:55.158178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:55.177626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] MFA Rules not processed for user `379a6ec0249d49e4971b44ece81b144e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:55.178825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:55.235564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1238/2468] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:56.772943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:56.844260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa7fc-6803-437e-ad08-c87e8d5ef49d service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:56.849367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:56.850085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:56.850434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:56.850780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] PATH_INFO: `/v3/users/6817a7ceb29a40ff8bf76b78c50e3112` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:56.852146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6817a7ceb29a40ff8bf76b78c50e3112)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:56.854204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:56.909715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6817a7ceb29a40ff8bf76b78c50e3112'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:56.929912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6817a7ceb29a40ff8bf76b78c50e3112'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:56.930533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6817a7ceb29a40ff8bf76b78c50e3112'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:56.942091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6817a7ceb29a40ff8bf76b78c50e3112'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:56.962819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6817a7ceb29a40ff8bf76b78c50e3112'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:56.971389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1231/2469] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:56 2022] DELETE /identity/v3/users/6817a7ceb29a40ff8bf76b78c50e3112 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:57.156054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:57.168173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec5edb-d712-4cde-b327-cf9b14ba81da None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:57.230162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:57.230792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:57.231068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:57.231334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] PATH_INFO: `/v3/projects/6b9399d6a5c94c6287698f5641a3f919` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:57.232518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9399d6a5c94c6287698f5641a3f919)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:57.234418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:57.281969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9399d6a5c94c6287698f5641a3f919', 'request_id': 'req-9d168287-0a77-430a-abab-52c0cda7dff2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.290709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9399d6a5c94c6287698f5641a3f919', 'request_id': 'req-9d168287-0a77-430a-abab-52c0cda7dff2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.296545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9399d6a5c94c6287698f5641a3f919', 'request_id': 'req-9d168287-0a77-430a-abab-52c0cda7dff2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.307442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] The token cache is being invalidate because project 6b9399d6a5c94c6287698f5641a3f919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:57.307726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.308380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.310101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1239/2470] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:57 2022] DELETE /identity/v3/projects/6b9399d6a5c94c6287698f5641a3f919 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:57.314274 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:57.315822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:57.329494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba26694-165f-465e-986c-5915ee5bea2c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:57.390409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:57.391061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:57.391343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:57.391672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] PATH_INFO: `/v3/users/40690d61258c48c68544e1c3cb4b28c1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:57.392893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] RBAC: Authorizing `identity:delete_user(user_id=40690d61258c48c68544e1c3cb4b28c1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:57.394940 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:57.418246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:57.448640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40690d61258c48c68544e1c3cb4b28c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.457950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40690d61258c48c68544e1c3cb4b28c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.458640 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40690d61258c48c68544e1c3cb4b28c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.466556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40690d61258c48c68544e1c3cb4b28c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.479434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dbb22afd-6820-449d-b5cd-90e7a853cdca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40690d61258c48c68544e1c3cb4b28c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.485954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1232/2471] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:36:57 2022] DELETE /identity/v3/users/40690d61258c48c68544e1c3cb4b28c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:57.702874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:57.705357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:57.729575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d168287-0a77-430a-abab-52c0cda7dff2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:57.799114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:57.837711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:57.838674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:57.838954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:57.839232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] PATH_INFO: `/v3/projects/d9821f4376694da3a1977c2c5434be63` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:57.840663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9821f4376694da3a1977c2c5434be63)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:57.842923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:57.902584 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9821f4376694da3a1977c2c5434be63', 'request_id': 'req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.912458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9821f4376694da3a1977c2c5434be63', 'request_id': 'req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.919528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9821f4376694da3a1977c2c5434be63', 'request_id': 'req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.934798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] The token cache is being invalidate because project d9821f4376694da3a1977c2c5434be63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:36:57.935286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.936738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5f20c0e8-2f64-44cd-9f7f-bf290e2e9dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:36:57.939173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1240/2472] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:36:57 2022] DELETE /identity/v3/projects/d9821f4376694da3a1977c2c5434be63 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:36:57.943820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:57.944727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:57.945246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:57.990990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:57.990990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:58.089457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1233/2473] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:36:58.092077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.092370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.092643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.118128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:58.119364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:58.128420 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1241/2474] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:58.132522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.142327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aac27f-6e53-48cf-81bc-8a1e9fcbe732 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.146856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.147456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.147730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.148029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.148670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:36:58.149019 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.150626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.167669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1234/2475] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:36:58.168983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.183018 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b26ce9-b6ee-4bbe-926e-ac4e1551f0e6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.188081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.188686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.188966 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.189235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.189867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.191752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.224501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1242/2476] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:36:58 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:36:58.225670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.236630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031086-126c-4f0c-8f1b-f6512a58e7ca admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.304919 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.305537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.305820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.306120 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.306784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.308820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.348606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1235/2477] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:36:58 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:36:58.352946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.363698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de423dc1-c6f1-4488-95df-17246ed1e51c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.368672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.369272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.369569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.369828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.370476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.372122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.382280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1243/2478] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:36:58.386473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.397217 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd17ae-c080-4dcb-bb0f-0c57e616898c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.401930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507d47b-4398-4343-b54f-ae5cbbbfb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.402540 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d47b-4398-4343-b54f-ae5cbbbfb7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.402822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d47b-4398-4343-b54f-ae5cbbbfb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.403094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d47b-4398-4343-b54f-ae5cbbbfb7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.404025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507d47b-4398-4343-b54f-ae5cbbbfb7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.406200 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507d47b-4398-4343-b54f-ae5cbbbfb7e7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.421582 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1236/2479] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:36:58.422825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.433984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5782c-ad55-4564-8447-48693ae3ca95 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.439014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.439752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.440135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.440417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] PATH_INFO: `/v3/projects/262ae41e79ab4ae39bc09396f55b7de9/users/7aef313432f546ed9ec101523af58e2f/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.456161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262ae41e79ab4ae39bc09396f55b7de9, user_id=7aef313432f546ed9ec101523af58e2f, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.458972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.473534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1244/2480] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:36:58 2022] PUT /identity/v3/projects/262ae41e79ab4ae39bc09396f55b7de9/users/7aef313432f546ed9ec101523af58e2f/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:36:58.484706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.484990 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.485355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.493459 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:58.515538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] MFA Rules not processed for user `7aef313432f546ed9ec101523af58e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:36:58.517214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:58.604541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1237/2481] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:36:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:36:58.615530 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:36:58.617600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:36:58.677616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d44976-cb07-40fb-8249-e51fe316ac72 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:36:58.681384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eac8e-67b7-4a83-a4c0-e867e2adb198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:36:58.681982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eac8e-67b7-4a83-a4c0-e867e2adb198 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:36:58.682225 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eac8e-67b7-4a83-a4c0-e867e2adb198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:36:58.682461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eac8e-67b7-4a83-a4c0-e867e2adb198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:36:58.691955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eac8e-67b7-4a83-a4c0-e867e2adb198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:36:58.693565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eac8e-67b7-4a83-a4c0-e867e2adb198 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:36:58.703525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1245/2482] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:36:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:01.762397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:01.829994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b6865-9491-4041-a3a0-3fb4db0f0e7d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:01.835151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:01.835794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:01.836202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:01.836484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] PATH_INFO: `/v3/users/7aef313432f546ed9ec101523af58e2f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:01.837727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aef313432f546ed9ec101523af58e2f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:01.839704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:01.888109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aef313432f546ed9ec101523af58e2f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:01.896289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aef313432f546ed9ec101523af58e2f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:01.897289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aef313432f546ed9ec101523af58e2f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:01.905437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aef313432f546ed9ec101523af58e2f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:01.918350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aef313432f546ed9ec101523af58e2f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:01.925012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1238/2483] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:37:01 2022] DELETE /identity/v3/users/7aef313432f546ed9ec101523af58e2f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:37:01.929241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:01.929733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:01.929834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:01.938246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:01.950349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:01.952891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:02.014503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1246/2484] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:02.024260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.025780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:02.040313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:02.086723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a5f8b-35c5-45e3-8bbd-24032f27f9d5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.090395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bd977-dee0-4cda-8658-d3123dad5004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.091002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd977-dee0-4cda-8658-d3123dad5004 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.091285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd977-dee0-4cda-8658-d3123dad5004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.091580 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd977-dee0-4cda-8658-d3123dad5004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.100781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bd977-dee0-4cda-8658-d3123dad5004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.102205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bd977-dee0-4cda-8658-d3123dad5004 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.112008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1239/2485] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:37:02.419683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.421096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:02.432644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040edff-9b9c-430e-b517-90760ad75d8e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.437140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.437770 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.438046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.438311 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] PATH_INFO: `/v3/projects/262ae41e79ab4ae39bc09396f55b7de9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.439412 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262ae41e79ab4ae39bc09396f55b7de9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.441320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.491945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262ae41e79ab4ae39bc09396f55b7de9', 'request_id': 'req-651bca78-8b01-4825-b397-bc10b32f0ea9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:02.500531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262ae41e79ab4ae39bc09396f55b7de9', 'request_id': 'req-651bca78-8b01-4825-b397-bc10b32f0ea9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:02.506860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262ae41e79ab4ae39bc09396f55b7de9', 'request_id': 'req-651bca78-8b01-4825-b397-bc10b32f0ea9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:02.519265 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] The token cache is being invalidate because project 262ae41e79ab4ae39bc09396f55b7de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:37:02.519442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:02.520127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651bca78-8b01-4825-b397-bc10b32f0ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:37:02.521866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1247/2486] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:37:02 2022] DELETE /identity/v3/projects/262ae41e79ab4ae39bc09396f55b7de9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:37:02.526474 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.526765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.527033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.547054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:02.548279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:02.610524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1240/2487] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:37:02.618623 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.618904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.619175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.639277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:02.640516 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:02.648373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1248/2488] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:37:02.652654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.662887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b67697-3c34-4cd5-ba0c-b5f4aab82c99 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.667493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.668125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.668403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.668674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.669312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:37:02.669613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.671211 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.682452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1241/2489] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:37:02.687044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.696131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a94f3-b35f-4ebb-bcc3-800da19d4464 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.700790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.701918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.702198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.702470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.703125 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.705066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.732458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1249/2490] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:37:02 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:37:02.736435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.746425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b7566-1adf-48d4-aff7-2a32799be0bb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.801051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.801922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.802202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.802471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.803083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.805090 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.826700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1242/2491] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:37:02 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:37:02.830771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.841006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bf8a-d8ac-472c-a51f-d03489aa02c8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.845745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.846364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.846640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.846910 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.847544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.849151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.858994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1250/2492] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:37:02.862718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.872713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65cb90-a592-4579-a94a-769b75b77b02 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.877993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d2f7f-ee99-47f9-9759-dcc615f2a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.878578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2f7f-ee99-47f9-9759-dcc615f2a67d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.878856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2f7f-ee99-47f9-9759-dcc615f2a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.879133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2f7f-ee99-47f9-9759-dcc615f2a67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.879767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d2f7f-ee99-47f9-9759-dcc615f2a67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.881380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d2f7f-ee99-47f9-9759-dcc615f2a67d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.896031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1243/2493] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:37:02.897166 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:02.908421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482333-0059-48ad-9569-b744a346bc4e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:02.912987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:02.913639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.913914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.914187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] PATH_INFO: `/v3/projects/8f2b4ed5a83a430490c72866006b5f57/users/f2d08596cf394dd9adab9164ca469ba9/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.928991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2b4ed5a83a430490c72866006b5f57, user_id=f2d08596cf394dd9adab9164ca469ba9, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:02.931692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:02.951988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1251/2494] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:37:02 2022] PUT /identity/v3/projects/8f2b4ed5a83a430490c72866006b5f57/users/f2d08596cf394dd9adab9164ca469ba9/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:37:02.956616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdee30e-7d42-4e28-8d2e-e26be0a89194 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:02.956971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdee30e-7d42-4e28-8d2e-e26be0a89194 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:02.957311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdee30e-7d42-4e28-8d2e-e26be0a89194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:02.980020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6bdee30e-7d42-4e28-8d2e-e26be0a89194 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:02.981264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6bdee30e-7d42-4e28-8d2e-e26be0a89194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:03.000258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:03.049543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1244/2495] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:37:03.059071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:03.061362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:03.088963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:03.120428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f48460-6743-487b-883d-3396d0818b9d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:03.124694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:03.125291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:03.125565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:03.125834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:03.134545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:03.135974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:03.145069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1252/2496] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:07.614870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:07.615442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:07.615442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:07.646245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] MFA Rules not processed for user `f2d08596cf394dd9adab9164ca469ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:07.647485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:07.758674 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1245/2497] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:07.762960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:07.774216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbd4cb-1091-45bf-aa2d-162c699eef94 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:07.779889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:07.780565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:07.780844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:07.781117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:07.781757 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:07.783744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:07.824758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1253/2498] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:37:07 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:37:07.828906 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:07.839824 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5fb01-41aa-4a95-80df-f9b23a382d28 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:07.898546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:07.899331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:07.899737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:07.900180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:07.900925 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:07.902954 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:07.951897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1246/2499] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:37:07 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:37:07.955907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:08.027035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee52a-565c-4c56-813d-e968bead6fbc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:08.032387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:08.033082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:08.033429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:08.033766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:08.034481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:08.036161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:08.060343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1254/2500] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:37:08.061688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:08.089539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:08.124275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3337c9-3911-4880-b302-ec0c7c09b715 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:08.129841 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:08.130653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:08.131037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:08.131408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] PATH_INFO: `/v3/projects/d81d987fa74346b79704a0b67620dacf/users/4eab86bafa2a403baf68c7c7daa9290f/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:08.152669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81d987fa74346b79704a0b67620dacf, user_id=4eab86bafa2a403baf68c7c7daa9290f, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:08.156334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:08.198914 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1247/2501] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:37:08 2022] PUT /identity/v3/projects/d81d987fa74346b79704a0b67620dacf/users/4eab86bafa2a403baf68c7c7daa9290f/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:37:08.202692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:08.213708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc5d8c-075d-4317-aefc-569490bee831 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:08.293698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab24c5-45fe-4c91-aa9a-86089c39ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:08.294639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab24c5-45fe-4c91-aa9a-86089c39ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:08.295508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab24c5-45fe-4c91-aa9a-86089c39ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:08.295877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab24c5-45fe-4c91-aa9a-86089c39ee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:08.296763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab24c5-45fe-4c91-aa9a-86089c39ee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:08.298541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab24c5-45fe-4c91-aa9a-86089c39ee08 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:08.310136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1255/2502] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:37:08.314361 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:08.326667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e300147-660f-4bdc-9f28-93f7d7f71f56 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:08.332871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:08.333693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:08.334084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:08.334463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] PATH_INFO: `/v3/projects/d81d987fa74346b79704a0b67620dacf/users/4eab86bafa2a403baf68c7c7daa9290f/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:08.337234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81d987fa74346b79704a0b67620dacf, user_id=4eab86bafa2a403baf68c7c7daa9290f, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:08.340295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:08.353050 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1248/2503] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:37:08 2022] PUT /identity/v3/projects/d81d987fa74346b79704a0b67620dacf/users/4eab86bafa2a403baf68c7c7daa9290f/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:37:13.914051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b3594-566a-4dd1-ac4e-2860e32a3022 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:13.914545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b3594-566a-4dd1-ac4e-2860e32a3022 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:13.914545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b3594-566a-4dd1-ac4e-2860e32a3022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:13.945915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7a0b3594-566a-4dd1-ac4e-2860e32a3022 None None] MFA Rules not processed for user `4eab86bafa2a403baf68c7c7daa9290f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:13.947063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7a0b3594-566a-4dd1-ac4e-2860e32a3022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:14.003884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:14.049830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1256/2504] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:14.069160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:14.071579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:14.160614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a9939-8c16-4e0e-9311-076d2f92fb03 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:14.164329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:14.164878 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:14.165160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:14.165492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:14.253678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:14.257804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:14.271160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1249/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:14.410369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a0e38-23fb-48f7-b374-d849010ccc7b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:14.410725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a0e38-23fb-48f7-b374-d849010ccc7b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:14.411059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a0e38-23fb-48f7-b374-d849010ccc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:14.444000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-708a0e38-23fb-48f7-b374-d849010ccc7b None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:14.445565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-708a0e38-23fb-48f7-b374-d849010ccc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:14.515145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1257/2506] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:14.577911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:14.579527 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:14.631073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:14.664031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19d91f-0e4d-4093-9bd0-14c0088eb9f5 service glance] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:14.670298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:14.670909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:14.671185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:14.671467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:14.680651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:14.682175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:14.691130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1250/2507] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:37:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:37:20.515446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e0d6-aee1-46f1-8c79-ee133ff32f97 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:20.516047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e0d6-aee1-46f1-8c79-ee133ff32f97 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:20.516143 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e0d6-aee1-46f1-8c79-ee133ff32f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:20.537302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-04d3e0d6-aee1-46f1-8c79-ee133ff32f97 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:20.538658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-04d3e0d6-aee1-46f1-8c79-ee133ff32f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:20.547669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1258/2508] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:20.561605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:20.573104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b434-b9b4-4ce4-9044-4108394b46ea service swift] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:20.578350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ad093-8350-4839-9148-0e9e2f1de4c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:20.579059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ad093-8350-4839-9148-0e9e2f1de4c9 service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:20.579902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ad093-8350-4839-9148-0e9e2f1de4c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:20.579902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ad093-8350-4839-9148-0e9e2f1de4c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:20.589334 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ad093-8350-4839-9148-0e9e2f1de4c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:20.590987 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ad093-8350-4839-9148-0e9e2f1de4c9 service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:20.600409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1251/2509] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:37:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:37:24.570596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:24.571101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:24.571218 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:24.593722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] MFA Rules not processed for user `f2d08596cf394dd9adab9164ca469ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:24.594937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:24.606358 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1259/2510] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:27.228142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:27.228654 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:27.229609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:27.272948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:27.272948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:27.275111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1252/2511] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:27.301797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:27.322986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefbfba-924b-4045-ba51-d9936b0aca59 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:27.332939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a03129-0406-49aa-85da-40435320201d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:27.333907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03129-0406-49aa-85da-40435320201d service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:27.334904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03129-0406-49aa-85da-40435320201d service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:27.335389 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a03129-0406-49aa-85da-40435320201d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:27.345908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03129-0406-49aa-85da-40435320201d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:27.347832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a03129-0406-49aa-85da-40435320201d service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:27.360577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1260/2512] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:37:37.253911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=21 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:37.354325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=55 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:48.435856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:48.437300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:48.529281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a981c-6599-47e7-8a9e-49af473e8fbf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:48.534277 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:48.534877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:48.535162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:48.535462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:48.537218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:48.548703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:48.550280 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c1a61-1818-4577-a680-6f41627c208b service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:48.561126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1253/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:50.217208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fc615-00ba-4338-907b-eb1f70c2413b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.218205 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fc615-00ba-4338-907b-eb1f70c2413b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.218484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fc615-00ba-4338-907b-eb1f70c2413b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.220316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1261/2514] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:37:50.227152 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aea13-50b8-4b77-8afa-251b4d93ec1e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.227630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aea13-50b8-4b77-8afa-251b4d93ec1e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.227743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aea13-50b8-4b77-8afa-251b4d93ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.284963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-884aea13-50b8-4b77-8afa-251b4d93ec1e None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:50.286393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-884aea13-50b8-4b77-8afa-251b4d93ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:50.370725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1254/2515] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:50.383011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fc615-00ba-4338-907b-eb1f70c2413b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:50.393727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fc615-00ba-4338-907b-eb1f70c2413b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:50.397329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a263d-aca0-4443-8056-4d9c26360288 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:50.397917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a263d-aca0-4443-8056-4d9c26360288 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.398195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a263d-aca0-4443-8056-4d9c26360288 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.398483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a263d-aca0-4443-8056-4d9c26360288 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.408321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a263d-aca0-4443-8056-4d9c26360288 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:50.409725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a263d-aca0-4443-8056-4d9c26360288 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:50.420580 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1262/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:50.501118 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc868efb-efc3-4d3c-b59a-7c8e5ca8d5ef None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.501405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc868efb-efc3-4d3c-b59a-7c8e5ca8d5ef None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.501687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc868efb-efc3-4d3c-b59a-7c8e5ca8d5ef None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.503042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1255/2517] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 12:37:50.507787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e327109-7532-4715-af47-e7e0894a621a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.508175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e327109-7532-4715-af47-e7e0894a621a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.508447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e327109-7532-4715-af47-e7e0894a621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.540034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6e327109-7532-4715-af47-e7e0894a621a None None] MFA Rules not processed for user `f34655a63e6441f995031cdf8770741e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:50.541196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e327109-7532-4715-af47-e7e0894a621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:50.601104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1263/2518] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:50.613750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc868efb-efc3-4d3c-b59a-7c8e5ca8d5ef None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:50.625478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc868efb-efc3-4d3c-b59a-7c8e5ca8d5ef None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:50.628976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502d2d-d5a3-4e9d-b71a-0b535d1fa7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:50.629840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502d2d-d5a3-4e9d-b71a-0b535d1fa7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.630127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502d2d-d5a3-4e9d-b71a-0b535d1fa7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.630400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502d2d-d5a3-4e9d-b71a-0b535d1fa7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.637316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8502d2d-d5a3-4e9d-b71a-0b535d1fa7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:50.638783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8502d2d-d5a3-4e9d-b71a-0b535d1fa7f4 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:50.646526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1256/2519] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:50.729282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ee750-a2fe-4786-83a7-f18f137ed0f2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.729569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ee750-a2fe-4786-83a7-f18f137ed0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.729869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ee750-a2fe-4786-83a7-f18f137ed0f2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.731223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1264/2520] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 22 12:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 12:37:50.736846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172232e7-a82b-4140-bd4a-5b6ff71bd9b1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.737156 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172232e7-a82b-4140-bd4a-5b6ff71bd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.737418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172232e7-a82b-4140-bd4a-5b6ff71bd9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.756998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-172232e7-a82b-4140-bd4a-5b6ff71bd9b1 None None] MFA Rules not processed for user `d671292a536e4a61931f1127f63c2883`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:50.758205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-172232e7-a82b-4140-bd4a-5b6ff71bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:50.767347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1257/2521] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 22 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:37:50.777766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ee750-a2fe-4786-83a7-f18f137ed0f2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:50.780077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1a2ee750-a2fe-4786-83a7-f18f137ed0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:50.793194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ee750-a2fe-4786-83a7-f18f137ed0f2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:50.797368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:50.797959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:50.798237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:50.798537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:50.808396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:50.809814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:50.820366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1265/2522] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:37:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:37:53.938301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:53.938739 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:53.939171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:53.960265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:37:53.961544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:37:53.968911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1258/2523] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 22 12:37:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:37:53.985197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:37:53.998327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e171187-73c8-47dc-9c7a-016c4df6b5a1 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:37:54.004251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431afd-c8ec-4bfc-abc8-73c30db62d3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:37:54.004969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431afd-c8ec-4bfc-abc8-73c30db62d3a service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:37:54.005294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431afd-c8ec-4bfc-abc8-73c30db62d3a service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:37:54.005551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431afd-c8ec-4bfc-abc8-73c30db62d3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:37:54.015230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd431afd-c8ec-4bfc-abc8-73c30db62d3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:37:54.017157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd431afd-c8ec-4bfc-abc8-73c30db62d3a service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:37:54.025405 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1266/2524] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:38:03.954531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:04.022087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=50 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:14.364623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:14.374890 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027eaf-5870-4ecf-8112-e1b3aaa4fb75 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:14.378445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:14.379033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:14.379308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:14.379574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:14.388449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:14.389861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:14.399267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1259/2525] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:38:16.538183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:16.538724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:16.538724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:16.569776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:16.571001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:16.579075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1267/2526] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 22 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:16.605392 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:16.620542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57ba5c-d198-4bb9-9b77-34f73448114c service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:16.629356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:16.630099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:16.630384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:16.630705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:16.641732 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:16.643507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:16.656751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1260/2527] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:38:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:38:26.564196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:26.650873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=12 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:28.280908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:28.290048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220e3b-9498-4496-bdaf-95bab63c6d65 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:28.293558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:28.294130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:28.295036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:28.295301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:28.297026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:28.358413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:28.359854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:28.369652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1268/2528] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:31.458431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:31.460144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:31.490045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738cc6-8233-4bb6-ad03-d2f460b624a5 service swift] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:31.495835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:31.496690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:31.496889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:31.497170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] PATH_INFO: `/v3/users/1904515c3a5c4b7c8844048fd9284cc8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:31.498389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1904515c3a5c4b7c8844048fd9284cc8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:31.500350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:31.559199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1904515c3a5c4b7c8844048fd9284cc8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.567396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1904515c3a5c4b7c8844048fd9284cc8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.570635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1904515c3a5c4b7c8844048fd9284cc8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.586703 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1904515c3a5c4b7c8844048fd9284cc8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.602651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4fd8c5ea-b41a-4f06-9c67-3d4a5da9e9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1904515c3a5c4b7c8844048fd9284cc8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.608742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1261/2529] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:31 2022] DELETE /identity/v3/users/1904515c3a5c4b7c8844048fd9284cc8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:31.796668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:31.807237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6671-b0e7-45ba-8888-3f1ae7768e93 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:31.865344 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:31.866078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:31.866424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:31.866743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] PATH_INFO: `/v3/projects/2b3ed217e3ec4b29a391147efd2c359f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:31.868325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3ed217e3ec4b29a391147efd2c359f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:31.870314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:31.915701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3ed217e3ec4b29a391147efd2c359f', 'request_id': 'req-06507e7c-2d10-49dc-96ad-4cf461f46331'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.922104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3ed217e3ec4b29a391147efd2c359f', 'request_id': 'req-06507e7c-2d10-49dc-96ad-4cf461f46331'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.928519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3ed217e3ec4b29a391147efd2c359f', 'request_id': 'req-06507e7c-2d10-49dc-96ad-4cf461f46331'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.939885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] The token cache is being invalidate because project 2b3ed217e3ec4b29a391147efd2c359f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:31.940211 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.940845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-06507e7c-2d10-49dc-96ad-4cf461f46331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:31.942339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1269/2530] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:31 2022] DELETE /identity/v3/projects/2b3ed217e3ec4b29a391147efd2c359f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:31.947401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:31.947717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:31.948033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:31.995342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:31.996590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:32.054946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1262/2531] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:32.063317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.063603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.063905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.083725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:32.084965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:32.093095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1270/2532] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:32.097322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.106753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9028239-1826-4d37-8b55-f684b37a9b5b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.111229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.111820 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.112124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.112399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.113040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:38:32.113342 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.114923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.127002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1263/2533] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:38:32.131195 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.140992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce43ef-a976-4e04-abbc-5a3c1a13fb43 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.145610 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.146198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.146475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.146741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.147354 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.149261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.164507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:32.177701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1271/2534] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:32.181729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.191875 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa1dc8-8409-4747-ab66-0d24305b84af admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.224677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:32.250179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.250782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.251057 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.251328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.251991 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.253932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.275345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1264/2535] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:32.279438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.289491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88776800-5142-4acc-9389-3c0a626f5969 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.294037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.295114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.295391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.295658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.296341 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.297908 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.307604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1272/2536] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:32.311791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.321378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e072cd0-f754-4f14-af61-7a9f8ba2b022 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.326052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd636a-9d31-4de5-9ff2-60742ed1612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.326634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd636a-9d31-4de5-9ff2-60742ed1612b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.326910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd636a-9d31-4de5-9ff2-60742ed1612b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.327181 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd636a-9d31-4de5-9ff2-60742ed1612b admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.327816 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd636a-9d31-4de5-9ff2-60742ed1612b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.329433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd636a-9d31-4de5-9ff2-60742ed1612b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.339776 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1265/2537] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:32.343814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.353666 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b02a-a20c-467b-80dd-b212d65e65fd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.358718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.359360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.359643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.359915 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] PATH_INFO: `/v3/projects/59244e0592a64ab9aba9f964ac54c6dd/users/ed96119043934dc4b8836176cf7aa9ae/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.374841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59244e0592a64ab9aba9f964ac54c6dd, user_id=ed96119043934dc4b8836176cf7aa9ae, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.377505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.389965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1273/2538] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:32 2022] PUT /identity/v3/projects/59244e0592a64ab9aba9f964ac54c6dd/users/ed96119043934dc4b8836176cf7aa9ae/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:32.401325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.401611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.401888 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.429539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] MFA Rules not processed for user `ed96119043934dc4b8836176cf7aa9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:32.430731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:32.493734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1266/2539] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:32.498751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.559229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fff907-0ec5-49ad-8059-9d3403add252 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.564446 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.565051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.565332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.565605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.566239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.568179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.596979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1274/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:32.599865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.611002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5c0e1-2650-4eea-a5d5-9048980e7749 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.668402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.669010 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.669929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.670204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.670843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.672785 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.693270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1267/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:32.697223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.707220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ea50-5e96-4be1-9eb8-8bfef184df16 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.711790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.712436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.712717 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.712987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.713622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.715204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.726157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1275/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:32.730147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.740618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73e4b-f3d5-469f-9655-0cb139cdbe9c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.745390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.746025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.746302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.746574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] PATH_INFO: `/v3/projects/ffc9f52ecefb4bb3b06b0acfb979fefd/users/2a782ecad5dc4358a39231c18e80fe40/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.760567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc9f52ecefb4bb3b06b0acfb979fefd, user_id=2a782ecad5dc4358a39231c18e80fe40, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.763176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.775183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1268/2543] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:32 2022] PUT /identity/v3/projects/ffc9f52ecefb4bb3b06b0acfb979fefd/users/2a782ecad5dc4358a39231c18e80fe40/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:32.779505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.789469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4931d-ca7a-4106-818e-0e6bc03e3b46 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.844737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868b93-6507-40b0-bfa9-b89e0b51e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.845401 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868b93-6507-40b0-bfa9-b89e0b51e342 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.845607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868b93-6507-40b0-bfa9-b89e0b51e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.845880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868b93-6507-40b0-bfa9-b89e0b51e342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.846514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868b93-6507-40b0-bfa9-b89e0b51e342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.848137 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868b93-6507-40b0-bfa9-b89e0b51e342 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.858559 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1276/2544] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:32.862687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:32.873035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b49c48-7660-48cc-8210-75da3c771426 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:32.877524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:32.878159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.878435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.878700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] PATH_INFO: `/v3/projects/ffc9f52ecefb4bb3b06b0acfb979fefd/users/2a782ecad5dc4358a39231c18e80fe40/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.880669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc9f52ecefb4bb3b06b0acfb979fefd, user_id=2a782ecad5dc4358a39231c18e80fe40, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:32.883350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:32.888908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:32.894441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1269/2545] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:32 2022] PUT /identity/v3/projects/ffc9f52ecefb4bb3b06b0acfb979fefd/users/2a782ecad5dc4358a39231c18e80fe40/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:32.905306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:32.905587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:32.905858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:32.934756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] MFA Rules not processed for user `2a782ecad5dc4358a39231c18e80fe40`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:32.936025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:32.954404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:33.006154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1277/2546] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:33.018056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:33.019766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:33.097015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51f9f1-0c64-4f71-a053-d92dd4468d20 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:33.100830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:33.101422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:33.101700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:33.101978 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:33.158372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:33.159800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:33.169855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1270/2547] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:34.520731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:34.522121 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:34.534865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dade8-3d58-403a-9064-73d663eb35d7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:34.538578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd607d5-88e5-4719-8419-46000ab5f074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:34.539179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd607d5-88e5-4719-8419-46000ab5f074 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:34.539578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd607d5-88e5-4719-8419-46000ab5f074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:34.539853 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd607d5-88e5-4719-8419-46000ab5f074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:34.548981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd607d5-88e5-4719-8419-46000ab5f074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:34.550438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd607d5-88e5-4719-8419-46000ab5f074 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:34.560076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1278/2548] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:38.532992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:38.598950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f0346-fbf1-4446-b69f-ea20525250b6 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:38.603949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:38.604585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:38.604865 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:38.605139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] PATH_INFO: `/v3/users/ed96119043934dc4b8836176cf7aa9ae` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:38.606275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed96119043934dc4b8836176cf7aa9ae)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:38.608760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:38.649952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:38.661698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed96119043934dc4b8836176cf7aa9ae'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:38.668861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed96119043934dc4b8836176cf7aa9ae'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:38.670031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed96119043934dc4b8836176cf7aa9ae'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:38.677214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed96119043934dc4b8836176cf7aa9ae'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:38.689473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed96119043934dc4b8836176cf7aa9ae'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:38.695702 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1271/2549] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:38 2022] DELETE /identity/v3/users/ed96119043934dc4b8836176cf7aa9ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:38.700320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:38.700792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:38.700792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:38.719876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:38.721086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:38.784751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1279/2550] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:38.795330 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:38.796900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:38.853366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0186cb-366d-4a94-8b2c-a2a89065cb92 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:38.857661 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:38.858265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:38.858546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:38.858821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:38.867787 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:38.869502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:38.878898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1272/2551] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:39.143290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:39.144758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:39.157894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beadc80-f7fb-47f4-9209-7be1ed079fab None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:39.162674 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:39.163325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:39.163598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:39.163863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] PATH_INFO: `/v3/projects/59244e0592a64ab9aba9f964ac54c6dd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:39.165689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59244e0592a64ab9aba9f964ac54c6dd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:39.167615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:39.215145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59244e0592a64ab9aba9f964ac54c6dd', 'request_id': 'req-761f6bfc-0f64-449f-96a0-afaf9709f673'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.223539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59244e0592a64ab9aba9f964ac54c6dd', 'request_id': 'req-761f6bfc-0f64-449f-96a0-afaf9709f673'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.229176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59244e0592a64ab9aba9f964ac54c6dd', 'request_id': 'req-761f6bfc-0f64-449f-96a0-afaf9709f673'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.240245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] The token cache is being invalidate because project 59244e0592a64ab9aba9f964ac54c6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:39.240534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.241208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.242831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1280/2552] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:39 2022] DELETE /identity/v3/projects/59244e0592a64ab9aba9f964ac54c6dd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:39.247132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:39.256720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e7441-4ae3-4ed5-ac3c-8e433072a04f service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:39.313966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:39.314645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:39.314962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:39.315220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] PATH_INFO: `/v3/users/2a782ecad5dc4358a39231c18e80fe40` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:39.316384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a782ecad5dc4358a39231c18e80fe40)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:39.318297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:39.365383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a782ecad5dc4358a39231c18e80fe40'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.372908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a782ecad5dc4358a39231c18e80fe40'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.373739 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a782ecad5dc4358a39231c18e80fe40'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.375847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:39.383040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a782ecad5dc4358a39231c18e80fe40'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.395664 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-652c3dc0-7959-471f-ae25-9d58520eae9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a782ecad5dc4358a39231c18e80fe40'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.401494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1273/2553] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:39 2022] DELETE /identity/v3/users/2a782ecad5dc4358a39231c18e80fe40 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:39.663127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:39.664644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:39.679069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6bfc-0f64-449f-96a0-afaf9709f673 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:39.706274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:39.744032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:39.744692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:39.745086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:39.745365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] PATH_INFO: `/v3/projects/ffc9f52ecefb4bb3b06b0acfb979fefd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:39.746512 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc9f52ecefb4bb3b06b0acfb979fefd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:39.748960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:39.806989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc9f52ecefb4bb3b06b0acfb979fefd', 'request_id': 'req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.815733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc9f52ecefb4bb3b06b0acfb979fefd', 'request_id': 'req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.822418 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc9f52ecefb4bb3b06b0acfb979fefd', 'request_id': 'req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.833901 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] The token cache is being invalidate because project ffc9f52ecefb4bb3b06b0acfb979fefd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:39.834184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.834930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99cf492b-24f5-4384-b3ee-3e0a4e410d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:39.836519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1281/2554] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:39 2022] DELETE /identity/v3/projects/ffc9f52ecefb4bb3b06b0acfb979fefd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:39.841715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:39.842222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:39.842336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:39.862479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:39.863673 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:39.923055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1274/2555] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:39.930811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:39.931092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:39.931365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:39.951428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:39.952651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:39.960470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1282/2556] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:39.964622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:39.974345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ec006-4043-4bf2-8dba-ef0ec721c27f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:39.980047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:39.980644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:39.980917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:39.981189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:39.982326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:38:39.982622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:39.984259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:39.996471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1275/2557] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:38:40.001164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.010556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb4cf1-8873-4d03-9fca-65e2fa23a3b3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.015080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.015663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.015957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.016226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.016852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.018722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.045551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1283/2558] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:40.049621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.059265 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f78c-f9da-46f9-b4b7-2ee82af1e697 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.117275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.117901 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.118447 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.118716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.119348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.121279 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.142798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1276/2559] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:40.146927 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.158000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d209d0c-6aef-41a3-9956-0a4f6af512c6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.162576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.163167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.163444 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.163713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.164388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.165990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.176500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1284/2560] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:40.180573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.191155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b7318-2c4e-443f-979e-7d2405f54373 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.195868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41e602-5ba0-48cf-a0ed-3c08aae78f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.196497 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41e602-5ba0-48cf-a0ed-3c08aae78f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.196772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41e602-5ba0-48cf-a0ed-3c08aae78f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.197040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41e602-5ba0-48cf-a0ed-3c08aae78f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.197746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41e602-5ba0-48cf-a0ed-3c08aae78f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.199287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41e602-5ba0-48cf-a0ed-3c08aae78f50 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.210585 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1277/2561] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:40.214588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.227609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d601-0920-4229-8506-2714c146ccda admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.232798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.233443 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.233721 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.233995 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] PATH_INFO: `/v3/projects/ec18c090566a48f4a454f6f826b3842e/users/d1d9c3649ecd4c81878e22869d05c8a4/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.248629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec18c090566a48f4a454f6f826b3842e, user_id=d1d9c3649ecd4c81878e22869d05c8a4, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.251190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.263783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1285/2562] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:40 2022] PUT /identity/v3/projects/ec18c090566a48f4a454f6f826b3842e/users/d1d9c3649ecd4c81878e22869d05c8a4/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:40.275023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.275305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.275600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.303895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] MFA Rules not processed for user `d1d9c3649ecd4c81878e22869d05c8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:40.305124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:40.332431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:40.369463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1278/2563] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:40.373952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.424504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:40.435676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ec83-6128-489a-a021-c6a790ad563f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.441188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.441789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.442070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.442345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.442974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.444953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.470704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1286/2564] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:40.474724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.485962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3bb6-296d-452b-b01a-373b151fbffd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.541595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.542128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.542406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.542681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.543303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.545267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.565747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1279/2565] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:40.569699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.580321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de22f9-af4a-4f56-bdeb-071141224d9f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.584889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.585597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.585881 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.586150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.586787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.588415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.599550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1287/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:40.603859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.613838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a84ca-a29a-4de7-84f7-7ae7d7b5a722 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.618718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df678e-350c-45a5-9421-5531404c4fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.619327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df678e-350c-45a5-9421-5531404c4fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.619637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df678e-350c-45a5-9421-5531404c4fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.619974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df678e-350c-45a5-9421-5531404c4fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.620621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df678e-350c-45a5-9421-5531404c4fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.622220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df678e-350c-45a5-9421-5531404c4fc4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.632520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1280/2567] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:40.637317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.648060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2408-3f1a-4b86-b7d4-8fd5c429ee87 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.652660 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.653301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.654204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.654476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] PATH_INFO: `/v3/projects/4404727e826844e3af0bdbc135aa5a17/users/0337e917a99f43a796bddc5f3a608aad/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.670403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4404727e826844e3af0bdbc135aa5a17, user_id=0337e917a99f43a796bddc5f3a608aad, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.673334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.687145 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1288/2568] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:40 2022] PUT /identity/v3/projects/4404727e826844e3af0bdbc135aa5a17/users/0337e917a99f43a796bddc5f3a608aad/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:40.697642 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.698064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.698468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.728440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] MFA Rules not processed for user `0337e917a99f43a796bddc5f3a608aad`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:40.729639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:40.797259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1281/2569] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:40.801825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.866156 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd3d77-342c-4c26-ac83-5aa55208a666 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.871298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.871905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.872817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.873090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.873718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.875603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:40.907126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1289/2570] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:40.908371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:40.919686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed37f-840d-47ac-a8c4-0e51fd9e433f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:40.955519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:40.981533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:40.982242 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:40.982525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:40.982796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:40.983499 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:40.985444 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:41.013843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1282/2571] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:40 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:41.014978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:41.030295 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f71e5-fb27-4840-b7e1-2b9955a4feed admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:41.035914 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:41.036549 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:41.036884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:41.037196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:41.037839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:41.039417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:41.050805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1290/2572] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:41.061154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:41.071696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261e984-b6c3-4b52-8e2c-497250485ed7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:41.077246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:41.078067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:41.078186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:41.078465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] PATH_INFO: `/v3/projects/30fcee0a98a34328b079a41474438ec4/users/59013189767e4fbd9a982ff42f05ea8c/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:41.096850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fcee0a98a34328b079a41474438ec4, user_id=59013189767e4fbd9a982ff42f05ea8c, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:41.099771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:41.117763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1283/2573] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:41 2022] PUT /identity/v3/projects/30fcee0a98a34328b079a41474438ec4/users/59013189767e4fbd9a982ff42f05ea8c/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:41.122935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:41.132981 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef35d7-f00d-48b8-bb58-c0fa892f32e2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:41.188501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff5ff-48c6-4a68-bc00-9949a671bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:41.189095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff5ff-48c6-4a68-bc00-9949a671bee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:41.189368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff5ff-48c6-4a68-bc00-9949a671bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:41.189634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff5ff-48c6-4a68-bc00-9949a671bee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:41.190259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ff5ff-48c6-4a68-bc00-9949a671bee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:41.191956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ff5ff-48c6-4a68-bc00-9949a671bee6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:41.203569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1291/2574] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:41.208012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:41.218199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb63cc-cdf1-47e2-ae4b-54fce66806a5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:41.222795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:41.223437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:41.223708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:41.224075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] PATH_INFO: `/v3/projects/30fcee0a98a34328b079a41474438ec4/users/59013189767e4fbd9a982ff42f05ea8c/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:41.225958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fcee0a98a34328b079a41474438ec4, user_id=59013189767e4fbd9a982ff42f05ea8c, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:41.228612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:41.238411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1284/2575] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:41 2022] PUT /identity/v3/projects/30fcee0a98a34328b079a41474438ec4/users/59013189767e4fbd9a982ff42f05ea8c/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:41.250272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:41.250558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:41.250836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:41.283617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:41.286726 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] MFA Rules not processed for user `59013189767e4fbd9a982ff42f05ea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:41.288547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:41.355004 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1292/2576] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:41.366561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:41.368536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:41.429428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6107-7563-4d3a-bf4c-e6f39643e7c5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:41.433049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:41.433980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:41.433980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:41.434170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:41.490760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:41.492210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:41.501727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1285/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:42.992502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:42.994172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:43.006722 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd7e6-1961-4c6e-b90c-5fdac83844a8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:43.010315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:43.010911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:43.011190 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:43.011461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:43.066249 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:43.067597 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:43.076291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1293/2578] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:43.583413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:43.592681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77ad04-38c3-45fb-8be1-643813a8a393 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:43.596266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cccaa1d-027f-4e64-9fd1-0347e4e221cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:43.596866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccaa1d-027f-4e64-9fd1-0347e4e221cc service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:43.597142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccaa1d-027f-4e64-9fd1-0347e4e221cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:43.597414 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cccaa1d-027f-4e64-9fd1-0347e4e221cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:43.606243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccaa1d-027f-4e64-9fd1-0347e4e221cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:43.607690 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cccaa1d-027f-4e64-9fd1-0347e4e221cc service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:43.617378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1286/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:47.597330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:47.659037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abedca-6710-49ff-8ab3-6ffa92bf5151 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:47.663503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:47.664155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:47.664434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:47.664704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] PATH_INFO: `/v3/users/d1d9c3649ecd4c81878e22869d05c8a4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:47.665814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d9c3649ecd4c81878e22869d05c8a4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:47.667780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:47.707192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:47.713898 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d9c3649ecd4c81878e22869d05c8a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:47.721169 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d9c3649ecd4c81878e22869d05c8a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:47.721778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d9c3649ecd4c81878e22869d05c8a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:47.728550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d9c3649ecd4c81878e22869d05c8a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:47.740644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d9c3649ecd4c81878e22869d05c8a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:47.746662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1294/2580] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:47 2022] DELETE /identity/v3/users/d1d9c3649ecd4c81878e22869d05c8a4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:47.751377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:47.751837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:47.751988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:47.771587 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:47.772830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:47.800454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:47.834142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1287/2581] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:47.844296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:47.845682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:47.903122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bea3b-9c20-4177-a118-a357f8498b86 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:47.907315 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:47.907919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:47.908236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:47.908510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:47.917778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:47.919860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:47.929235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1295/2582] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:48.210932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:48.212465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:48.225826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573edd7-286e-4724-b3ff-d90fdd139696 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:48.231838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:48.232643 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:48.233028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:48.233454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] PATH_INFO: `/v3/projects/ec18c090566a48f4a454f6f826b3842e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:48.234725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec18c090566a48f4a454f6f826b3842e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:48.236832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:48.293526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec18c090566a48f4a454f6f826b3842e', 'request_id': 'req-c5c1fd13-c2e8-4f11-b387-4263a82102f9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.303772 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec18c090566a48f4a454f6f826b3842e', 'request_id': 'req-c5c1fd13-c2e8-4f11-b387-4263a82102f9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.309720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec18c090566a48f4a454f6f826b3842e', 'request_id': 'req-c5c1fd13-c2e8-4f11-b387-4263a82102f9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.320679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] The token cache is being invalidate because project ec18c090566a48f4a454f6f826b3842e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:48.320969 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.321683 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.323248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1288/2583] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:48 2022] DELETE /identity/v3/projects/ec18c090566a48f4a454f6f826b3842e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:48.327856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:48.337759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaaf88-733f-4503-a579-054346bd67d6 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:48.398460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:48.399084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:48.399360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:48.399630 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] PATH_INFO: `/v3/users/0337e917a99f43a796bddc5f3a608aad` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:48.400780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0337e917a99f43a796bddc5f3a608aad)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:48.402750 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:48.450104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0337e917a99f43a796bddc5f3a608aad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.457848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0337e917a99f43a796bddc5f3a608aad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.458465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0337e917a99f43a796bddc5f3a608aad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.463730 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:48.465860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0337e917a99f43a796bddc5f3a608aad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.479430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0337e917a99f43a796bddc5f3a608aad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.485621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1296/2584] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:48 2022] DELETE /identity/v3/users/0337e917a99f43a796bddc5f3a608aad => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:48.756986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:48.758506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:48.771963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1fd13-c2e8-4f11-b387-4263a82102f9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:48.827139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:48.827774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:48.828072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:48.828344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] PATH_INFO: `/v3/projects/4404727e826844e3af0bdbc135aa5a17` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:48.829435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4404727e826844e3af0bdbc135aa5a17)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:48.831315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:48.876428 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4404727e826844e3af0bdbc135aa5a17', 'request_id': 'req-6286198d-833d-4e92-a501-48d5d379e924'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.883779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4404727e826844e3af0bdbc135aa5a17', 'request_id': 'req-6286198d-833d-4e92-a501-48d5d379e924'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.884989 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:48.891858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4404727e826844e3af0bdbc135aa5a17', 'request_id': 'req-6286198d-833d-4e92-a501-48d5d379e924'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.902996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] The token cache is being invalidate because project 4404727e826844e3af0bdbc135aa5a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:48.903286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.904609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:48.906088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1289/2585] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:48 2022] DELETE /identity/v3/projects/4404727e826844e3af0bdbc135aa5a17 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:48.910222 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:48.911670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:48.924515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343b5a5-3c1c-4629-a6fe-0e6214bb2932 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:48.984321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:48.985041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:48.985320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:48.985590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] PATH_INFO: `/v3/users/59013189767e4fbd9a982ff42f05ea8c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:48.986719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59013189767e4fbd9a982ff42f05ea8c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:48.988686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.034771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59013189767e4fbd9a982ff42f05ea8c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.042155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59013189767e4fbd9a982ff42f05ea8c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.042969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59013189767e4fbd9a982ff42f05ea8c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.050260 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59013189767e4fbd9a982ff42f05ea8c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.062196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59013189767e4fbd9a982ff42f05ea8c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.068090 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1297/2586] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:48 2022] DELETE /identity/v3/users/59013189767e4fbd9a982ff42f05ea8c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:49.329687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.331322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:49.347408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286198d-833d-4e92-a501-48d5d379e924 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.412754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.414093 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:49.417746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.418391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.418676 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.418982 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] PATH_INFO: `/v3/projects/30fcee0a98a34328b079a41474438ec4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.420191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fcee0a98a34328b079a41474438ec4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.422094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.474353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fcee0a98a34328b079a41474438ec4', 'request_id': 'req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.474543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07900040-713e-4019-bb8d-f20a6ab8a0a8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.482506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fcee0a98a34328b079a41474438ec4', 'request_id': 'req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.485176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:49.489959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fcee0a98a34328b079a41474438ec4', 'request_id': 'req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.502796 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] The token cache is being invalidate because project 30fcee0a98a34328b079a41474438ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:49.503071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.503709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cda29f47-cbef-4eeb-ad21-804c1dafd6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:49.505201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1290/2587] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:49 2022] DELETE /identity/v3/projects/30fcee0a98a34328b079a41474438ec4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:49.509909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aef40-c699-4a32-a9f9-32ca99d00b59 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.510186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aef40-c699-4a32-a9f9-32ca99d00b59 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.510455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aef40-c699-4a32-a9f9-32ca99d00b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.529920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.530587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.530852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.531116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-327aef40-c699-4a32-a9f9-32ca99d00b59 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:49.531233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.532355 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-327aef40-c699-4a32-a9f9-32ca99d00b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:49.532866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:49.595626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1291/2588] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:49.597398 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.598859 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.603804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.604189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.604534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.609214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1298/2589] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:38:49.626026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:49.627283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:49.635184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1292/2590] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:49.639429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.649369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e1bac-b4a8-4305-bdb4-a45ecee8a031 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.654138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.654744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.655023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.655296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.655959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:38:49.656303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.657939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.673639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1299/2591] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:38:49.674913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.684310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ced3d7-187b-4d36-b2f6-b367593b996f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.689510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.690109 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.690381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.690651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.691290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.693202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.698574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:49.726666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1293/2592] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:49 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:49.727835 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.738077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf119bf-6bcf-4aee-940a-e6f2d9ae2112 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.795476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.796174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.796457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.796728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.797379 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.799397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.821382 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1300/2593] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:49 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:49.825729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.836188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9d4da-647a-4131-84dd-e42a9fece7a9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.840957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.841562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.841847 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.842121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.842765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.844400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.855537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1294/2594] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:49.860251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.870760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760065-01ed-485d-9f24-2c241308ecbf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.876110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e397c5-d454-468c-92c5-741168c08dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.876840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e397c5-d454-468c-92c5-741168c08dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.877124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e397c5-d454-468c-92c5-741168c08dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.877396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e397c5-d454-468c-92c5-741168c08dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.878036 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e397c5-d454-468c-92c5-741168c08dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.879615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e397c5-d454-468c-92c5-741168c08dbe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.890513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1301/2595] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:49.894895 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:49.905662 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711fd26-87d7-4e7c-86f8-c42a2fcb788d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:49.910326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:49.910973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.911255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.911536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] PATH_INFO: `/v3/projects/b00ca1dc78fc4bb79d55c49910885c10/users/c23e45be4dd8431aae0a864dde1fcb00/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.927326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00ca1dc78fc4bb79d55c49910885c10, user_id=c23e45be4dd8431aae0a864dde1fcb00, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:49.930016 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:49.943621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1295/2596] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:49 2022] PUT /identity/v3/projects/b00ca1dc78fc4bb79d55c49910885c10/users/c23e45be4dd8431aae0a864dde1fcb00/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:49.953866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:49.954330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:49.954427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:49.983690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] MFA Rules not processed for user `c23e45be4dd8431aae0a864dde1fcb00`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:49.984958 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:50.002700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:50.053328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1302/2597] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:50.064625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:50.066327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:50.124701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab9403-55fa-4fad-91f9-bb4d7007deb6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:50.128354 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb1070-90ce-4c59-a30a-a69fddba1451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:50.128950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1070-90ce-4c59-a30a-a69fddba1451 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:50.129225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1070-90ce-4c59-a30a-a69fddba1451 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:50.129494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1070-90ce-4c59-a30a-a69fddba1451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:50.137760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb1070-90ce-4c59-a30a-a69fddba1451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:50.139239 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb1070-90ce-4c59-a30a-a69fddba1451 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:50.149170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1296/2598] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:52.757564 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:52.834094 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf510d84-1da3-42b2-bb29-73e525134069 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:52.839168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:52.840429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:52.840429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:52.840682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] PATH_INFO: `/v3/users/c23e45be4dd8431aae0a864dde1fcb00` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:52.841832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23e45be4dd8431aae0a864dde1fcb00)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:52.843825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:52.906763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23e45be4dd8431aae0a864dde1fcb00'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:52.919971 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23e45be4dd8431aae0a864dde1fcb00'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:52.921136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23e45be4dd8431aae0a864dde1fcb00'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:52.931098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23e45be4dd8431aae0a864dde1fcb00'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:52.954138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23e45be4dd8431aae0a864dde1fcb00'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:52.961851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1303/2599] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:52 2022] DELETE /identity/v3/users/c23e45be4dd8431aae0a864dde1fcb00 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:52.966544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:52.967007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:52.967214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:52.987058 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:52.988294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.052832 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1297/2600] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:53.059598 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.061136 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.104278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.105742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.115852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:53.127400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027e2a-da05-40d9-a630-1b0969986a21 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.133000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.133633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.133912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.134187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] PATH_INFO: `/v3/users/379a6ec0249d49e4971b44ece81b144e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.135332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379a6ec0249d49e4971b44ece81b144e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.137286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.140331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016783-4c95-415c-86fc-dc4497839bd1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.144217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.144823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.145104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.145372 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.155775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.157248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.167693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1304/2601] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:53.195309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379a6ec0249d49e4971b44ece81b144e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.199572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:53.210861 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379a6ec0249d49e4971b44ece81b144e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.211792 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379a6ec0249d49e4971b44ece81b144e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.222302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379a6ec0249d49e4971b44ece81b144e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.241718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379a6ec0249d49e4971b44ece81b144e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.248458 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1298/2602] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:53 2022] DELETE /identity/v3/users/379a6ec0249d49e4971b44ece81b144e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:53.422351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.436984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3ea9b-d6a0-481b-9f4a-d535cb129ac6 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.470767 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.472912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.536316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.536316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.536316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.536316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] PATH_INFO: `/v3/projects/6b943914bd144254b332fedee587a08c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.537538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b943914bd144254b332fedee587a08c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.537538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.574024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b56fb-d696-46d2-9379-1a829b5879a8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.579516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.580273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.580726 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.580996 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] PATH_INFO: `/v3/projects/b00ca1dc78fc4bb79d55c49910885c10` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.583416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00ca1dc78fc4bb79d55c49910885c10)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.585363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.594520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b943914bd144254b332fedee587a08c', 'request_id': 'req-59479ccb-1228-4a1d-b3a6-a2319891a344'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.603672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b943914bd144254b332fedee587a08c', 'request_id': 'req-59479ccb-1228-4a1d-b3a6-a2319891a344'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.610857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b943914bd144254b332fedee587a08c', 'request_id': 'req-59479ccb-1228-4a1d-b3a6-a2319891a344'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.626866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] The token cache is being invalidate because project 6b943914bd144254b332fedee587a08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:53.627338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.629115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-59479ccb-1228-4a1d-b3a6-a2319891a344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.630102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1305/2603] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:53 2022] DELETE /identity/v3/projects/6b943914bd144254b332fedee587a08c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:53.634758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702e82-eb77-413a-9410-a5cc3b2840f6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.635025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702e82-eb77-413a-9410-a5cc3b2840f6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.635304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702e82-eb77-413a-9410-a5cc3b2840f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.643881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00ca1dc78fc4bb79d55c49910885c10', 'request_id': 'req-f98fc284-97c2-421d-9642-1273db6821f0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.652710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00ca1dc78fc4bb79d55c49910885c10', 'request_id': 'req-f98fc284-97c2-421d-9642-1273db6821f0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.657591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-64702e82-eb77-413a-9410-a5cc3b2840f6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:53.658425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00ca1dc78fc4bb79d55c49910885c10', 'request_id': 'req-f98fc284-97c2-421d-9642-1273db6821f0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.659011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-64702e82-eb77-413a-9410-a5cc3b2840f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.669315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] The token cache is being invalidate because project b00ca1dc78fc4bb79d55c49910885c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:53.669604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.670248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f98fc284-97c2-421d-9642-1273db6821f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:53.671718 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1299/2604] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:53 2022] DELETE /identity/v3/projects/b00ca1dc78fc4bb79d55c49910885c10 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:53.676400 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46779-f2fc-41d6-886a-9ccbc866e3da None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.676749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46779-f2fc-41d6-886a-9ccbc866e3da None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.677111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd46779-f2fc-41d6-886a-9ccbc866e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.697345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8bd46779-f2fc-41d6-886a-9ccbc866e3da None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:53.698549 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8bd46779-f2fc-41d6-886a-9ccbc866e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.719346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1306/2605] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:53.727682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.727989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.728270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.748619 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:53.750009 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.756547 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:53.758377 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1307/2606] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:53.762696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.768890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:53.773112 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f87879-8578-4743-b2ba-e74a4c7044d3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.775854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1300/2607] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:53.777086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.777379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.777658 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.779323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.780161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.780493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.781078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.781822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:38:53.782124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.783701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.795465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1308/2608] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:38:53.797326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:53.798519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:53.799745 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.806421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1301/2609] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:53.809202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5016e-f968-4892-83cd-b04dd258a599 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.810880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.814613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.815422 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.815756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.818850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.818850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.819338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.820199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d1df9-bb4b-4d08-846d-a3105479eda2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.827763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.828411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.828687 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.828958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.829860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:38:53.830170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.831762 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.844329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1302/2610] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:38:53.849052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.861154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1309/2611] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:53.861336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce314ea-013b-4eff-a770-d5a6b011d6c8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.862196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.918669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.919327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.919614 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.919889 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.920545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.922442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.926847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7d0b7-2290-4088-8179-6ee7ea3742ea admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:53.931920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:53.932593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:53.932869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:53.933140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:53.933773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:53.936234 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:53.955214 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1303/2612] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:53.959589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.960856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1310/2613] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:53.964793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:53.974276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec0d76-2b38-44e1-ac70-e9730f93c93b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.022605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4edda-e692-40df-913a-6f5b0af88c91 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.027390 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.028017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.028327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.028597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.029275 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.030900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.031119 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.031510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.031787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.032096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.032729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.034306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.044733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1311/2614] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:54.048935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.056271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1304/2615] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:53 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:54.057283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.058854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3b5a-09ef-4658-9ec0-e2eeb5d5e886 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.064085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.064680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.064961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.065233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.065865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.067436 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.068040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241a0d9-5050-4fda-b4a6-eec1b72c5fab admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.073069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.073647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.073923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.074218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.074877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.076537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.081474 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1312/2616] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:54.082434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.089379 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1305/2617] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:54.090461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.091797 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fd179-7655-494d-8813-8a084987a1b6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.096348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0958e-57e0-4872-b2cf-6cc2bb9e45e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.096974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0958e-57e0-4872-b2cf-6cc2bb9e45e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.097248 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0958e-57e0-4872-b2cf-6cc2bb9e45e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.097517 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0958e-57e0-4872-b2cf-6cc2bb9e45e0 admin admin] PATH_INFO: `/v3/projects/8340e66561e6496291f57138ab084bb5/users/32d202c83ca64b44b0f9cdc97cd96065/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.099838 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5133d57-9d2f-4065-8caf-3d4ca97b3202 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.104431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.105001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.105276 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.105545 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.106162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.108431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.112347 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0958e-57e0-4872-b2cf-6cc2bb9e45e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8340e66561e6496291f57138ab084bb5, user_id=32d202c83ca64b44b0f9cdc97cd96065, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.114954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0958e-57e0-4872-b2cf-6cc2bb9e45e0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.120741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1306/2618] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:54.129733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1313/2619] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:54 2022] PUT /identity/v3/projects/8340e66561e6496291f57138ab084bb5/users/32d202c83ca64b44b0f9cdc97cd96065/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:54.131125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.142162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c74b7-0783-4d2b-9bcb-f19a1e9839f5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.142761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecccd18-0e48-4235-a47b-f27b1386b9c4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.143246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecccd18-0e48-4235-a47b-f27b1386b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.145551 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecccd18-0e48-4235-a47b-f27b1386b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.174233 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7ecccd18-0e48-4235-a47b-f27b1386b9c4 None None] MFA Rules not processed for user `32d202c83ca64b44b0f9cdc97cd96065`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:54.175314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:54.175468 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7ecccd18-0e48-4235-a47b-f27b1386b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:54.185173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:54.210483 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.211149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.211435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.211710 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] PATH_INFO: `/v3/projects/e6316f8e978448eb85cddeff084067f5/users/a5a15143d36e41209c420d6df1a58824/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.226026 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6316f8e978448eb85cddeff084067f5, user_id=a5a15143d36e41209c420d6df1a58824, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.228709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.242282 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1307/2620] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:54 2022] PUT /identity/v3/projects/e6316f8e978448eb85cddeff084067f5/users/a5a15143d36e41209c420d6df1a58824/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:54.246617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1314/2621] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:54.247963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.253478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21832896-6955-46e7-8987-32167fac442a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.253762 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21832896-6955-46e7-8987-32167fac442a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.254043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21832896-6955-46e7-8987-32167fac442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.282305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-21832896-6955-46e7-8987-32167fac442a None None] MFA Rules not processed for user `a5a15143d36e41209c420d6df1a58824`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:54.283515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21832896-6955-46e7-8987-32167fac442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:54.308295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b5906-bc97-4dd1-9d3b-15ead67748e8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.313501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.314094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.314367 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.314634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.315249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.317170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.347288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1308/2622] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:54 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:54.348302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.354827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1315/2623] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:38:54.363782 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21832896-6955-46e7-8987-32167fac442a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.365255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21832896-6955-46e7-8987-32167fac442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:54.413004 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9249fb2-608b-4406-81b7-2a9c8a020c83 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.417647 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.418249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.418529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.418801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.420071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.421988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.422905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21832896-6955-46e7-8987-32167fac442a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.444149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1309/2624] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:54 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:38:54.447819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.457297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0179da-f2ab-4122-90c6-d4c146134c9c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.462496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.463172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.463595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.463883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.464622 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.466835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.474342 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.474974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.475247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.475515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.479961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1310/2625] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:54.482426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.487431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:54.492803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3b139-9aaa-4fdb-871c-d3460fc6f805 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.497722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.498359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.498639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.498913 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] PATH_INFO: `/v3/projects/3eee95249ba344b7a772704766b95439/users/b54f2adeec5f4df2929103f47c36ae23/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.513383 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee95249ba344b7a772704766b95439, user_id=b54f2adeec5f4df2929103f47c36ae23, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.516051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.518202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:54.532554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1311/2626] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:54 2022] PUT /identity/v3/projects/3eee95249ba344b7a772704766b95439/users/b54f2adeec5f4df2929103f47c36ae23/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:54.536462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.540820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.542267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.551830 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1316/2627] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:38:54.602042 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7016-52af-48e5-879d-13a426759714 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.607486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880f3f7-0740-4a5c-a09f-f889d4b2f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.608146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f3f7-0740-4a5c-a09f-f889d4b2f9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.608465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f3f7-0740-4a5c-a09f-f889d4b2f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.608798 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880f3f7-0740-4a5c-a09f-f889d4b2f9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.609610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880f3f7-0740-4a5c-a09f-f889d4b2f9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.612299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880f3f7-0740-4a5c-a09f-f889d4b2f9a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.624452 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1312/2628] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:38:54.628996 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.640778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394878-8c3e-47ba-b465-a7a214cf08b4 service glance] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.645544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.646199 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.646472 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.646739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] PATH_INFO: `/v3/projects/3eee95249ba344b7a772704766b95439/users/b54f2adeec5f4df2929103f47c36ae23/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.649179 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee95249ba344b7a772704766b95439, user_id=b54f2adeec5f4df2929103f47c36ae23, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.652042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.663183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1317/2629] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:54 2022] PUT /identity/v3/projects/3eee95249ba344b7a772704766b95439/users/b54f2adeec5f4df2929103f47c36ae23/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:54.675677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.675986 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.676269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.703825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] MFA Rules not processed for user `b54f2adeec5f4df2929103f47c36ae23`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:54.704971 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:54.773955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1313/2630] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:54.785448 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:54.787434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:54.849475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337955c-3893-4839-9b64-51ae2e8d9ae8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:54.853816 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00121c-d925-40e8-aa4f-906658991938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:54.854532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00121c-d925-40e8-aa4f-906658991938 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:54.854857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00121c-d925-40e8-aa4f-906658991938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:54.855237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00121c-d925-40e8-aa4f-906658991938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:54.865047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00121c-d925-40e8-aa4f-906658991938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:54.866735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00121c-d925-40e8-aa4f-906658991938 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:54.877540 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1318/2631] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:55.040591 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:55.103243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121eb2ec-b091-4062-a6ca-f9b5635dff17 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:55.107747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:55.108546 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:55.108859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:55.109133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] PATH_INFO: `/v3/users/32d202c83ca64b44b0f9cdc97cd96065` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:55.110267 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d202c83ca64b44b0f9cdc97cd96065)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:55.112189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:55.128115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:55.159823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d202c83ca64b44b0f9cdc97cd96065'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.168340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d202c83ca64b44b0f9cdc97cd96065'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.169115 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d202c83ca64b44b0f9cdc97cd96065'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.176621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d202c83ca64b44b0f9cdc97cd96065'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.189231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d202c83ca64b44b0f9cdc97cd96065'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.198068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1314/2632] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:55 2022] DELETE /identity/v3/users/32d202c83ca64b44b0f9cdc97cd96065 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:55.205150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:55.205373 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:55.205644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:55.224788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:55.225865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:55.285531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1319/2633] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:55.296680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:55.298130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:55.359121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95aaf5-05c8-4cad-882f-c27d05a4f317 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:55.363431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:55.364074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:55.364437 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:55.364712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:55.376853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:55.378373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:55.390125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1315/2634] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:55.664498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:55.666165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:55.680634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffc3f3-bdae-4476-b214-e5f50ae08629 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:55.686154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:55.686820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:55.687100 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:55.687924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] PATH_INFO: `/v3/projects/8340e66561e6496291f57138ab084bb5` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:55.689286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8340e66561e6496291f57138ab084bb5)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:55.691274 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:55.729818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:55.741232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8340e66561e6496291f57138ab084bb5', 'request_id': 'req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.749221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8340e66561e6496291f57138ab084bb5', 'request_id': 'req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.755501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8340e66561e6496291f57138ab084bb5', 'request_id': 'req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.766661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] The token cache is being invalidate because project 8340e66561e6496291f57138ab084bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:55.766942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.767552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:55.769095 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1320/2635] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:55 2022] DELETE /identity/v3/projects/8340e66561e6496291f57138ab084bb5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:55.773516 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:55.788049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034388b-490b-42f0-b360-fa9772015c3c service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:55.972290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:55.972923 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:55.973201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:55.973480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] PATH_INFO: `/v3/users/b54f2adeec5f4df2929103f47c36ae23` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:55.974578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54f2adeec5f4df2929103f47c36ae23)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:55.976534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.023227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:56.030297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54f2adeec5f4df2929103f47c36ae23'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.040218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54f2adeec5f4df2929103f47c36ae23'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.040872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54f2adeec5f4df2929103f47c36ae23'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.049148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54f2adeec5f4df2929103f47c36ae23'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.061963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6d5d1189-780c-4924-99e4-bb9e496f01e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54f2adeec5f4df2929103f47c36ae23'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.067789 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1316/2636] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:38:55 2022] DELETE /identity/v3/users/b54f2adeec5f4df2929103f47c36ae23 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:56.346110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.347625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:56.368459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdb6a0-aff5-4c6c-857b-18774f9f4fcc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.426780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.427410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.427691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.427986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] PATH_INFO: `/v3/projects/3eee95249ba344b7a772704766b95439` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.429151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eee95249ba344b7a772704766b95439)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.431306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.480200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eee95249ba344b7a772704766b95439', 'request_id': 'req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.489626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eee95249ba344b7a772704766b95439', 'request_id': 'req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.495889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eee95249ba344b7a772704766b95439', 'request_id': 'req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.507026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] The token cache is being invalidate because project 3eee95249ba344b7a772704766b95439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:38:56.507450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.508104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d7ff738-a15c-43fb-902d-8f9c7d4886c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:38:56.509587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1321/2637] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:38:56 2022] DELETE /identity/v3/projects/3eee95249ba344b7a772704766b95439 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:56.514995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.515284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.515571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.535404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:56.536590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:56.600080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1317/2638] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:56.607854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.608238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.608519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.632419 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:56.633746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:56.642725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1322/2639] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:56.646910 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.656826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fb711-9441-4b50-b5cd-1be9bae6e06e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.661485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.662077 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.662351 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.662617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.663255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:38:56.663551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.665159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.676532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1318/2640] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:38:56.680776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.690603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4e8b6-1ab5-4b1a-a50a-5444198b12c6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.696353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.696998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.697275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.697544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.698198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.700728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.727178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1323/2641] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:56 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:56.731406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.741163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e153981-a9c0-4f18-a7da-a56ef051af94 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.799075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.799574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.799851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.800148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.800840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.802729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.826206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1319/2642] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:56 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:56.830380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.840616 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cf208-12d9-41c1-a121-db1b6e57b2fc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.850103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.850883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.851245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.851544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.852356 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.854343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.866408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1324/2643] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:56.870760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.881394 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce1fd1-3b74-4102-81eb-4b0f8bfb1398 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.886154 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dcc66-7686-4aa7-a353-e0046e1f71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.886769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dcc66-7686-4aa7-a353-e0046e1f71cb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.887028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dcc66-7686-4aa7-a353-e0046e1f71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.887299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dcc66-7686-4aa7-a353-e0046e1f71cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.888596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dcc66-7686-4aa7-a353-e0046e1f71cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.890176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dcc66-7686-4aa7-a353-e0046e1f71cb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.903131 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1320/2644] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:56.904338 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:56.914294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33838b2-2f25-4975-a8f1-48bcb2e84763 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:56.918895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:56.919536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.919813 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.920119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] PATH_INFO: `/v3/projects/3afba116d1bf4640ba0a7b94dd00824a/users/7c377ced66024302b91208fddabd3544/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.930878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:56.936381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afba116d1bf4640ba0a7b94dd00824a, user_id=7c377ced66024302b91208fddabd3544, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:56.939573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:56.956114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1325/2645] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:56 2022] PUT /identity/v3/projects/3afba116d1bf4640ba0a7b94dd00824a/users/7c377ced66024302b91208fddabd3544/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:56.966408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:56.966693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:56.966994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:56.995227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] MFA Rules not processed for user `7c377ced66024302b91208fddabd3544`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:56.996473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:57.007191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:57.063699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1321/2646] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:57.068107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.138728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db80f-91c8-4617-ad33-b6000c0f3814 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.143441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.144076 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.144366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.144634 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.145314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.147171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.174447 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1326/2647] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:38:57 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:57.178561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.189606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3040bb-25b2-4120-9cb7-b87e0b8edb66 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.248724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.249336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.249612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.249883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.250522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.252493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.274233 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1322/2648] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:38:57 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:38:57.278290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.288483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab58ad-dcfc-4cf3-a578-56fa03f32cd3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.293229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.294408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.294688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.294960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.295615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.297307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.308519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1327/2649] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:57.313178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.323087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98db3c-9c0a-44c8-99a7-ebd3b2b28c78 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.327583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.328258 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.328537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.328811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] PATH_INFO: `/v3/projects/5b3d93169c764de2a54aa4165afe137e/users/2d702e71c24643d6bc847c791a31afa3/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.343867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3d93169c764de2a54aa4165afe137e, user_id=2d702e71c24643d6bc847c791a31afa3, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.346543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.360194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1323/2650] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:57 2022] PUT /identity/v3/projects/5b3d93169c764de2a54aa4165afe137e/users/2d702e71c24643d6bc847c791a31afa3/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:38:57.364307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.375021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760fcfe-52bd-421a-aa82-35c3516acf61 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.430985 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1538e-2acc-4c7f-9e05-3c12283f96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.431589 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1538e-2acc-4c7f-9e05-3c12283f96ac admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.431867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1538e-2acc-4c7f-9e05-3c12283f96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.432173 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1538e-2acc-4c7f-9e05-3c12283f96ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.432810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1538e-2acc-4c7f-9e05-3c12283f96ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.434409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1538e-2acc-4c7f-9e05-3c12283f96ac admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.448035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1328/2651] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:38:57.449241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.459837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f340bd-9b8c-4a75-a1e6-0b056bf5a4c5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.465159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.466429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.466704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.466859 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] PATH_INFO: `/v3/projects/5b3d93169c764de2a54aa4165afe137e/users/2d702e71c24643d6bc847c791a31afa3/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.468819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3d93169c764de2a54aa4165afe137e, user_id=2d702e71c24643d6bc847c791a31afa3, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.471416 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.482232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1324/2652] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:38:57 2022] PUT /identity/v3/projects/5b3d93169c764de2a54aa4165afe137e/users/2d702e71c24643d6bc847c791a31afa3/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:38:57.494120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.494399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.494672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.521961 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] MFA Rules not processed for user `2d702e71c24643d6bc847c791a31afa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:38:57.523146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:57.572456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:57.596483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1329/2653] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:38:57.608195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.609915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:38:57.666993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358c2ba-f18c-4b78-ae39-d36fa8f0bc57 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.671163 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.671754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.672061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.672329 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.682463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.683893 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.693509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1325/2654] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:38:57.770858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:38:57.783329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec9b4f-5219-41d3-915b-4fb4a3b9e093 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:38:57.786957 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf52cc1-4e7b-46b4-bf66-c5b3ec91e5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:38:57.787568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf52cc1-4e7b-46b4-bf66-c5b3ec91e5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:38:57.787845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf52cc1-4e7b-46b4-bf66-c5b3ec91e5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:38:57.788151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf52cc1-4e7b-46b4-bf66-c5b3ec91e5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:38:57.845184 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf52cc1-4e7b-46b4-bf66-c5b3ec91e5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:38:57.846679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf52cc1-4e7b-46b4-bf66-c5b3ec91e5d8 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:38:57.855370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1330/2655] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:38:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:04.951460 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:04.960079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:05.016716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768b12-7bd5-4901-9839-65a63c9d0ba3 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:05.021396 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:05.022059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:05.022350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:05.022646 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] PATH_INFO: `/v3/users/7c377ced66024302b91208fddabd3544` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:05.024013 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c377ced66024302b91208fddabd3544)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:05.026021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:05.072001 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c377ced66024302b91208fddabd3544'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.080406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c377ced66024302b91208fddabd3544'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.081024 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c377ced66024302b91208fddabd3544'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.087863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c377ced66024302b91208fddabd3544'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.100066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c377ced66024302b91208fddabd3544'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.105817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1326/2656] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:04 2022] DELETE /identity/v3/users/7c377ced66024302b91208fddabd3544 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:05.111046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:05.111538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:05.111644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:05.132575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:05.133789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:05.192604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1331/2657] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:05.202749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:05.204307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:05.259830 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2ddde-fb28-4bfe-b557-4820408fce0f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:05.263920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:05.264532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:05.264804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:05.265072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:05.273868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:05.275272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:05.285104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1327/2658] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:05.545592 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:05.547214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:05.576128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a26f17-4d65-41d4-92c1-e3da8e949ebd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:05.580771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:05.581467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:05.581746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:05.582014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] PATH_INFO: `/v3/projects/3afba116d1bf4640ba0a7b94dd00824a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:05.583133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afba116d1bf4640ba0a7b94dd00824a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:05.585069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:05.631191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afba116d1bf4640ba0a7b94dd00824a', 'request_id': 'req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.639071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afba116d1bf4640ba0a7b94dd00824a', 'request_id': 'req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.644535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afba116d1bf4640ba0a7b94dd00824a', 'request_id': 'req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.655703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] The token cache is being invalidate because project 3afba116d1bf4640ba0a7b94dd00824a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:05.656019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.656662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.658239 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1332/2659] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:05 2022] DELETE /identity/v3/projects/3afba116d1bf4640ba0a7b94dd00824a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:05.662398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:05.672261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587df41c-cbd8-44d0-8dcf-555cb19cde7f service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:05.697507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:05.728542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:05.729160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:05.729435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:05.729701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] PATH_INFO: `/v3/users/2d702e71c24643d6bc847c791a31afa3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:05.730799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d702e71c24643d6bc847c791a31afa3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:05.732867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:05.776952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d702e71c24643d6bc847c791a31afa3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.784596 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d702e71c24643d6bc847c791a31afa3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.785269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d702e71c24643d6bc847c791a31afa3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.791994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d702e71c24643d6bc847c791a31afa3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.803433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-83a999b5-dd0e-4c58-95fb-da93b3c489fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d702e71c24643d6bc847c791a31afa3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:05.809063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1328/2660] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:05 2022] DELETE /identity/v3/users/2d702e71c24643d6bc847c791a31afa3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:06.073510 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.075070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:06.091209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97900ec9-c542-4b4d-a94a-fbb5a4e049e4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.094970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:06.155034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.155688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.155897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.156202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] PATH_INFO: `/v3/projects/5b3d93169c764de2a54aa4165afe137e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.157537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3d93169c764de2a54aa4165afe137e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.159438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.206725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3d93169c764de2a54aa4165afe137e', 'request_id': 'req-477b54bb-4651-40d4-a952-b82c16272cd6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:06.214139 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3d93169c764de2a54aa4165afe137e', 'request_id': 'req-477b54bb-4651-40d4-a952-b82c16272cd6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:06.219649 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3d93169c764de2a54aa4165afe137e', 'request_id': 'req-477b54bb-4651-40d4-a952-b82c16272cd6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:06.230459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] The token cache is being invalidate because project 5b3d93169c764de2a54aa4165afe137e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:06.230743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:06.231873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-477b54bb-4651-40d4-a952-b82c16272cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:06.233386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1333/2661] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:06 2022] DELETE /identity/v3/projects/5b3d93169c764de2a54aa4165afe137e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:06.238446 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.238947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.239465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.261677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:06.262883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:06.323385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1329/2662] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:06.331500 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.331788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.332131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.351479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:06.352716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:06.361101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1334/2663] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:06.365438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.375959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be057914-9d02-4626-b794-a1b6c58d87c1 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.380515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.381105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.381385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.381660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.382298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:06.382602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.384229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.395463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1330/2664] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:06.399818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.409416 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12da77-bfbe-4b64-b36c-800ecf52f22f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.413991 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.414604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.414882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.415155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.415778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.417699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.446748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1335/2665] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:06.448887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.458606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9547585-a9f4-46f5-adbd-60f95bd4b1b1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.490974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:06.516650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.517251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.517525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.517793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.518405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.520322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.541463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1331/2666] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:06.546198 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.556432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637375cd-c458-4b10-bc35-9a95eaad373d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.561130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.561718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.561992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.562254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.562884 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.564504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.574453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1336/2667] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:06.578463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.589285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bbd82-affa-49a1-b863-12fd211f4a50 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.594915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb3c7-1bf7-433d-82b9-d01a4ae7554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.595590 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb3c7-1bf7-433d-82b9-d01a4ae7554e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.595872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb3c7-1bf7-433d-82b9-d01a4ae7554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.596174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb3c7-1bf7-433d-82b9-d01a4ae7554e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.596850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafb3c7-1bf7-433d-82b9-d01a4ae7554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.598463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafb3c7-1bf7-433d-82b9-d01a4ae7554e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.616904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1332/2668] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:06.623069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.633126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00238b0c-66ab-4c7a-8dd7-a5549c25bce2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.637702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.638348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.638626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.638894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] PATH_INFO: `/v3/projects/0ab5b8fabd4e440687a52168842b739b/users/5a178d1110594c0aaac06d6b5590d290/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.654073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab5b8fabd4e440687a52168842b739b, user_id=5a178d1110594c0aaac06d6b5590d290, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.657879 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.674328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1337/2669] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:06 2022] PUT /identity/v3/projects/0ab5b8fabd4e440687a52168842b739b/users/5a178d1110594c0aaac06d6b5590d290/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:06.684773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.685053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.685325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.712020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] MFA Rules not processed for user `5a178d1110594c0aaac06d6b5590d290`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:06.713219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:06.776220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1333/2670] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:06.781425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.814465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:06.843058 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4771-753a-4d5c-b171-69d3c780e81b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.847678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.848308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.848582 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.848850 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.849480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.851360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.877801 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1338/2671] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:06.881823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:06.892822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bfb66-b6eb-4f5c-a11c-7272ebcae7ac None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:06.949369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:06.949877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:06.950721 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:06.950965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:06.951593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:06.956082 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:06.989886 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1334/2672] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:06 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:06.991104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:07.001557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e7d6-e4c4-4db0-b8e9-496ac1e3e47f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:07.006092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:07.006678 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.006954 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.007223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.007885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:07.009482 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:07.020320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1339/2673] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:07.024353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:07.034837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af3a82-2418-476c-9821-685348c8bdc2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:07.039402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:07.040084 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.040363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.040633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] PATH_INFO: `/v3/projects/dccc65bdf78847988d90626566072963/users/0c671b287b0142718ba647f5fe6c12c8/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.054668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccc65bdf78847988d90626566072963, user_id=0c671b287b0142718ba647f5fe6c12c8, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:07.057338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:07.070422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1335/2674] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:07 2022] PUT /identity/v3/projects/dccc65bdf78847988d90626566072963/users/0c671b287b0142718ba647f5fe6c12c8/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:07.074457 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:07.084812 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406fe2-9ba3-4e5f-9cc5-9a80f640bbae admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:07.141381 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea2bb5-3680-4968-b5cb-ca7123905713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:07.141982 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2bb5-3680-4968-b5cb-ca7123905713 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.142255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2bb5-3680-4968-b5cb-ca7123905713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.142521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea2bb5-3680-4968-b5cb-ca7123905713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.143146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea2bb5-3680-4968-b5cb-ca7123905713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:07.144749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea2bb5-3680-4968-b5cb-ca7123905713 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:07.156263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1340/2675] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:07.160408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:07.170535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290eeb9-841b-44fd-9195-7331016195e9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:07.175116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:07.175753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.176070 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.176344 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] PATH_INFO: `/v3/projects/dccc65bdf78847988d90626566072963/users/0c671b287b0142718ba647f5fe6c12c8/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.178234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccc65bdf78847988d90626566072963, user_id=0c671b287b0142718ba647f5fe6c12c8, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:07.180868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:07.183850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:07.192368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1336/2676] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:07 2022] PUT /identity/v3/projects/dccc65bdf78847988d90626566072963/users/0c671b287b0142718ba647f5fe6c12c8/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:07.204781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.205064 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.205335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.232386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] MFA Rules not processed for user `0c671b287b0142718ba647f5fe6c12c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:07.233573 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:07.300132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1341/2677] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:07.311305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:07.313159 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:07.368649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed9de-1a92-4c53-94e3-6bffb3a32edd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:07.373035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:07.373641 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.373898 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.374167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.382765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:07.384208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:07.393884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1337/2678] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:07.439060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:07.440556 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:07.453086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef92c08-36f6-4655-a277-4df5a9b7c628 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:07.456629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558feb1-2168-45a0-9a1e-9d47a1c73321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:07.457220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558feb1-2168-45a0-9a1e-9d47a1c73321 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:07.457496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558feb1-2168-45a0-9a1e-9d47a1c73321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:07.457765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558feb1-2168-45a0-9a1e-9d47a1c73321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:07.483800 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:07.515535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558feb1-2168-45a0-9a1e-9d47a1c73321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:07.517002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558feb1-2168-45a0-9a1e-9d47a1c73321 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:07.525754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1342/2679] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:10.803085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:10.867504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799564c6-26bc-43e2-8fe9-0a12813c3218 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:10.872945 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:10.873566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:10.873844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:10.874121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] PATH_INFO: `/v3/users/5a178d1110594c0aaac06d6b5590d290` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:10.875234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a178d1110594c0aaac06d6b5590d290)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:10.877160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:10.921755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a178d1110594c0aaac06d6b5590d290'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:10.928723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a178d1110594c0aaac06d6b5590d290'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:10.929341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a178d1110594c0aaac06d6b5590d290'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:10.936161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a178d1110594c0aaac06d6b5590d290'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:10.947668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a178d1110594c0aaac06d6b5590d290'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:10.953488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1338/2680] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:10 2022] DELETE /identity/v3/users/5a178d1110594c0aaac06d6b5590d290 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:10.957945 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:10.958467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:10.958467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:10.977464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:10.978741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:11.037720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1343/2681] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:11.047831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:11.049253 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:11.069029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:11.107502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c40dc-3376-407e-946d-7934055b99ad admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:11.111143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:11.111738 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:11.112045 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:11.112317 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:11.121363 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:11.122799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:11.132053 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1339/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:11.398307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:11.399820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:11.415989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1681b-cd7b-4663-8942-1a125745de57 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:11.421417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:11.421976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:11.422284 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:11.422502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] PATH_INFO: `/v3/projects/0ab5b8fabd4e440687a52168842b739b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:11.423741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab5b8fabd4e440687a52168842b739b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:11.425718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:11.596025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab5b8fabd4e440687a52168842b739b', 'request_id': 'req-91d7b6fd-ca32-4085-9633-61de72402c11'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.603259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab5b8fabd4e440687a52168842b739b', 'request_id': 'req-91d7b6fd-ca32-4085-9633-61de72402c11'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.608809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab5b8fabd4e440687a52168842b739b', 'request_id': 'req-91d7b6fd-ca32-4085-9633-61de72402c11'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.620023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] The token cache is being invalidate because project 0ab5b8fabd4e440687a52168842b739b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:11.620306 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.620918 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.622869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1344/2683] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:11 2022] DELETE /identity/v3/projects/0ab5b8fabd4e440687a52168842b739b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:11.626947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:11.636399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8ac5-e158-4715-a64e-2542d6c8a346 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:11.693180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:11.693797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:11.694068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:11.694335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] PATH_INFO: `/v3/users/0c671b287b0142718ba647f5fe6c12c8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:11.695433 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c671b287b0142718ba647f5fe6c12c8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:11.697353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:11.741378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c671b287b0142718ba647f5fe6c12c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.749061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c671b287b0142718ba647f5fe6c12c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.749729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c671b287b0142718ba647f5fe6c12c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.756464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c671b287b0142718ba647f5fe6c12c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.768621 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-035ebb85-076f-4ebc-82ee-be8643760f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c671b287b0142718ba647f5fe6c12c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:11.774519 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1340/2684] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:11 2022] DELETE /identity/v3/users/0c671b287b0142718ba647f5fe6c12c8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:12.050715 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.052176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:12.066855 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b6fd-ca32-4085-9633-61de72402c11 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.113118 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:12.125840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.126470 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.126748 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.127019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] PATH_INFO: `/v3/projects/dccc65bdf78847988d90626566072963` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.128272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccc65bdf78847988d90626566072963)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.130204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.175091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccc65bdf78847988d90626566072963', 'request_id': 'req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:12.181756 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccc65bdf78847988d90626566072963', 'request_id': 'req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:12.187978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccc65bdf78847988d90626566072963', 'request_id': 'req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:12.199032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] The token cache is being invalidate because project dccc65bdf78847988d90626566072963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:12.199316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:12.199977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1c1bc5f1-5112-41c4-ab6c-7a3314603f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:12.201461 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1345/2685] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:12 2022] DELETE /identity/v3/projects/dccc65bdf78847988d90626566072963 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:12.206255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.206700 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.206801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.225810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:12.227007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:12.260831 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:12.286518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1341/2686] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:12.295170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.295455 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.295727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.315261 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:12.316479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:12.324483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1346/2687] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:12.328897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.338287 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051d518-e5d4-462b-b1f5-98f103c98296 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.342860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.343445 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.343725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.344030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.344655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:12.344956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.346525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.358482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1342/2688] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:12.362775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.372600 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4bd5a-96fa-49fe-af59-8a0d7c4b0d72 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.377131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.377714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.377987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.378255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.378871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.380784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.415888 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1347/2689] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:12.420544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.430294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c006257-5db8-4c07-88f1-6a7d597f296f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.484650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.485250 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.485532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.485804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.486485 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.488434 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.509139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1343/2690] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:12.514128 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.524980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c784b-6278-41aa-afe7-5c42e5f8d98c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.530106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.530705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.530984 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.531255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.531886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.533481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.543178 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1348/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:12.547579 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.557212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3a3ab-44d6-4087-8772-0ec4f2ab4aad admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.561704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ead94-99ae-43ef-901c-d8c7a946afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.562288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ead94-99ae-43ef-901c-d8c7a946afcf admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.562563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ead94-99ae-43ef-901c-d8c7a946afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.562833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ead94-99ae-43ef-901c-d8c7a946afcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.563456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ead94-99ae-43ef-901c-d8c7a946afcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.565062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ead94-99ae-43ef-901c-d8c7a946afcf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.576223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1344/2692] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:12.580235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.590154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678516-48f7-4935-ad23-d699f5129c71 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.595104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.595738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.596054 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.596327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] PATH_INFO: `/v3/projects/3da1496fa5684dc4b577fb11bf619759/users/bac4540ea89341ecb87a91ccc99707b3/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.611276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da1496fa5684dc4b577fb11bf619759, user_id=bac4540ea89341ecb87a91ccc99707b3, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.613917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.626258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1349/2693] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:12 2022] PUT /identity/v3/projects/3da1496fa5684dc4b577fb11bf619759/users/bac4540ea89341ecb87a91ccc99707b3/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:12.637570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.637852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.638128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.664905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] MFA Rules not processed for user `bac4540ea89341ecb87a91ccc99707b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:12.666086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:12.727422 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1345/2694] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:12.732657 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.791843 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867db931-77e3-4544-a9c6-31625698f509 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.797025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.797615 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.797893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.798165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.798793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.800704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.814796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:12.828869 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1350/2695] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:12.832868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.843743 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb847e-694a-4fba-baf3-006c50f1c26c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.875943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:12.900143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.900749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.901027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.901301 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.901930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.904389 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.926657 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1346/2696] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:12 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:12.930709 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.940728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a7f11-15f7-4711-9d52-390acd92f3a3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.945291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.945877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.946150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.946511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.947041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.948627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:12.958671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1351/2697] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:12.962560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:12.972925 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65f81-a2ea-48b1-8af7-4e8a503f48a4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:12.977496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:12.978126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:12.978405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:12.978754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] PATH_INFO: `/v3/projects/b6b5ac7649db4727baf6b403b7769aa5/users/dbedd2cdf97648fcb380cd2c45372a07/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:12.995052 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b5ac7649db4727baf6b403b7769aa5, user_id=dbedd2cdf97648fcb380cd2c45372a07, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:12.997697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:13.010087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1347/2698] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:12 2022] PUT /identity/v3/projects/b6b5ac7649db4727baf6b403b7769aa5/users/dbedd2cdf97648fcb380cd2c45372a07/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:13.014155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:13.023832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388332-3cc5-4e98-bc46-d7ed41175ff5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:13.078170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b27746-e387-4e07-abbc-28d7e9e2651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:13.078778 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27746-e387-4e07-abbc-28d7e9e2651c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:13.078951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27746-e387-4e07-abbc-28d7e9e2651c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:13.079215 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b27746-e387-4e07-abbc-28d7e9e2651c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:13.079836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b27746-e387-4e07-abbc-28d7e9e2651c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:13.081485 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b27746-e387-4e07-abbc-28d7e9e2651c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:13.091575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1352/2699] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:13.095863 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:13.105924 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e19bff-c9bb-42af-8298-de064880bab6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:13.111029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:13.111659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:13.111952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:13.112220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] PATH_INFO: `/v3/projects/b6b5ac7649db4727baf6b403b7769aa5/users/dbedd2cdf97648fcb380cd2c45372a07/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:13.114210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b5ac7649db4727baf6b403b7769aa5, user_id=dbedd2cdf97648fcb380cd2c45372a07, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:13.116973 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:13.127271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1348/2700] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:13 2022] PUT /identity/v3/projects/b6b5ac7649db4727baf6b403b7769aa5/users/dbedd2cdf97648fcb380cd2c45372a07/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:13.138038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:13.138321 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:13.138595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:13.167122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] MFA Rules not processed for user `dbedd2cdf97648fcb380cd2c45372a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:13.168362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:13.234581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1353/2701] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:13.245393 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:13.247112 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:13.302651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce89558-c22e-4887-8b62-713c351491d7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:13.306183 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:13.306766 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:13.307040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:13.307310 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:13.316089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:13.317488 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:13.327149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1349/2702] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:13.427241 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:13.436807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541de78-c30b-4c93-b15d-df16de25403e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:13.440339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41543376-61b7-470f-9e7f-d8a04c1b0509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:13.440931 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543376-61b7-470f-9e7f-d8a04c1b0509 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:13.441207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543376-61b7-470f-9e7f-d8a04c1b0509 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:13.441477 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41543376-61b7-470f-9e7f-d8a04c1b0509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:13.496993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41543376-61b7-470f-9e7f-d8a04c1b0509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:13.498399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41543376-61b7-470f-9e7f-d8a04c1b0509 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:13.507014 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1354/2703] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:16.089737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:16.150106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0ff27-2448-4b75-9c31-c73af4567dc6 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:16.154730 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:16.155952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:16.156269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:16.156541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] PATH_INFO: `/v3/users/bac4540ea89341ecb87a91ccc99707b3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:16.157698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac4540ea89341ecb87a91ccc99707b3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:16.159598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:16.192284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:16.206828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac4540ea89341ecb87a91ccc99707b3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.214775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac4540ea89341ecb87a91ccc99707b3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.215432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac4540ea89341ecb87a91ccc99707b3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.222240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac4540ea89341ecb87a91ccc99707b3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.233560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac4540ea89341ecb87a91ccc99707b3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.239170 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1350/2704] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:16 2022] DELETE /identity/v3/users/bac4540ea89341ecb87a91ccc99707b3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:16.243633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:16.244369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:16.244487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:16.251962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:16.266467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:16.267661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:16.330119 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1355/2705] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:16.339686 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:16.341096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:16.396462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667840-8e81-408a-adf2-4d49f157e7ad admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:16.400017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:16.400593 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:16.400868 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:16.401142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:16.410005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:16.411417 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:16.420768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1351/2706] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:16.709511 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:16.710944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:16.726146 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ce9e9-7c70-46b5-9303-94a450e60eb6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:16.732413 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:16.733548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:16.733823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:16.734056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] PATH_INFO: `/v3/projects/3da1496fa5684dc4b577fb11bf619759` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:16.735181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da1496fa5684dc4b577fb11bf619759)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:16.737114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:16.787909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da1496fa5684dc4b577fb11bf619759', 'request_id': 'req-ec8c59a0-4906-492c-a220-a0c739100ecf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.801180 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da1496fa5684dc4b577fb11bf619759', 'request_id': 'req-ec8c59a0-4906-492c-a220-a0c739100ecf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.807851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da1496fa5684dc4b577fb11bf619759', 'request_id': 'req-ec8c59a0-4906-492c-a220-a0c739100ecf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.819829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] The token cache is being invalidate because project 3da1496fa5684dc4b577fb11bf619759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:16.820037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.820682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.822374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1356/2707] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:16 2022] DELETE /identity/v3/projects/3da1496fa5684dc4b577fb11bf619759 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:16.826371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:16.837150 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaae9f-7232-4557-b250-f9e31f02e222 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:16.900583 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:16.901218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:16.901501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:16.901777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] PATH_INFO: `/v3/users/dbedd2cdf97648fcb380cd2c45372a07` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:16.902932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbedd2cdf97648fcb380cd2c45372a07)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:16.905408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:16.951509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbedd2cdf97648fcb380cd2c45372a07'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.958754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbedd2cdf97648fcb380cd2c45372a07'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.959380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbedd2cdf97648fcb380cd2c45372a07'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.960603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:16.969033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbedd2cdf97648fcb380cd2c45372a07'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.982475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e12b321b-4467-47b8-9f7d-d54f014683c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbedd2cdf97648fcb380cd2c45372a07'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:16.989977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1352/2708] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:16 2022] DELETE /identity/v3/users/dbedd2cdf97648fcb380cd2c45372a07 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:17.260141 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.261796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:17.275886 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c59a0-4906-492c-a220-a0c739100ecf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.333308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.333935 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.334214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.334484 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] PATH_INFO: `/v3/projects/b6b5ac7649db4727baf6b403b7769aa5` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.335640 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b5ac7649db4727baf6b403b7769aa5)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.337514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.367948 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:17.385351 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b5ac7649db4727baf6b403b7769aa5', 'request_id': 'req-997dc3ff-009c-4374-ae79-2b9deeee49ac'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:17.392780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b5ac7649db4727baf6b403b7769aa5', 'request_id': 'req-997dc3ff-009c-4374-ae79-2b9deeee49ac'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:17.398531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b5ac7649db4727baf6b403b7769aa5', 'request_id': 'req-997dc3ff-009c-4374-ae79-2b9deeee49ac'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:17.409907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] The token cache is being invalidate because project b6b5ac7649db4727baf6b403b7769aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:17.410197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:17.410820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-997dc3ff-009c-4374-ae79-2b9deeee49ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:17.412314 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1357/2709] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:17 2022] DELETE /identity/v3/projects/b6b5ac7649db4727baf6b403b7769aa5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:17.417251 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.417746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.417860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.437781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:17.438967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:17.496911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1353/2710] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:17.504700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.504983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.505255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.525290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:17.526479 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:17.534844 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1358/2711] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:17.538943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.548308 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bea8e-f204-4029-b6e5-87d9f5b49913 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.553037 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.553632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.553908 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.554180 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.554821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:17.555124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.556777 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.568245 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1354/2712] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:17.572326 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.581975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d165951-33cf-44e5-abce-285a88d6de4a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.586690 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.587221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.587498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.587769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.588441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.590318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.616929 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1359/2713] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:17 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:17.621230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.630810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c073-79bc-4d7a-87bd-b7850b61fe7a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.685347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.685943 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.686734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.687028 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.687869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.689851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.711552 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1355/2714] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:17 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:17.715651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.725780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2ef0-fbea-4d26-b55b-f812ee763035 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.730294 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.730887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.731162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.731432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.732106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.733701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.743388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1360/2715] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:17.747562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.757848 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d72206-739b-4d35-84c0-fa38cea94d56 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.762375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79bee-d555-4c52-b5dc-44e4ac81d1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.762961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79bee-d555-4c52-b5dc-44e4ac81d1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.763238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79bee-d555-4c52-b5dc-44e4ac81d1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.763508 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79bee-d555-4c52-b5dc-44e4ac81d1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.764176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a79bee-d555-4c52-b5dc-44e4ac81d1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.766271 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a79bee-d555-4c52-b5dc-44e4ac81d1e6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.777060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1356/2716] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:17.781131 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:17.790804 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca30bc1-679d-472b-8aca-d70dfdfad55a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:17.795297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:17.795944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.796230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.796515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] PATH_INFO: `/v3/projects/ae730a154f7a464ba5ff963569f9f063/users/67be98615c2440e38fe75aa2e52118f2/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.810466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae730a154f7a464ba5ff963569f9f063, user_id=67be98615c2440e38fe75aa2e52118f2, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:17.813665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:17.825849 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1361/2717] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:17 2022] PUT /identity/v3/projects/ae730a154f7a464ba5ff963569f9f063/users/67be98615c2440e38fe75aa2e52118f2/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:17.837698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:17.837927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:17.838203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:17.866828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] MFA Rules not processed for user `67be98615c2440e38fe75aa2e52118f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:17.868064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:17.896126 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:17.938223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1357/2718] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:17.942729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.013322 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa13a14-f948-4a5f-bf3d-a5b920d97163 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.018507 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.019110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.019388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.019662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.020335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.022207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.049276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1362/2719] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:17 2022] POST /identity/v3/projects => generated 409 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:18.053326 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.064295 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ecff-bedf-4879-89ba-934e57e6843b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.117975 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.118504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.118781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.119312 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.119946 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.121837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.145595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1358/2720] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:18 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:18.149504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.159900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b4ab-08a9-47fb-8d93-83982e928695 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.164490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.165077 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.165352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.165622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.166252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.167836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.179515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1363/2721] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:18.183572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.194099 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ef36d-6c8f-4b01-ab07-6246d088fc95 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.198783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.199918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.199918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.200146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] PATH_INFO: `/v3/projects/f483fe9ef3e547e2a5ba246447fedde2/users/2b38a5bc1e3b4d7a94b9725fd3d9e6ec/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.214492 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f483fe9ef3e547e2a5ba246447fedde2, user_id=2b38a5bc1e3b4d7a94b9725fd3d9e6ec, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.217153 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.229425 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1359/2722] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:18 2022] PUT /identity/v3/projects/f483fe9ef3e547e2a5ba246447fedde2/users/2b38a5bc1e3b4d7a94b9725fd3d9e6ec/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:18.233894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.243513 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d48a72-fc66-4c32-b6d0-82473cf6dcb0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.267655 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:18.302355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ad4d6-27da-4406-8e51-6ee8320857b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.302960 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad4d6-27da-4406-8e51-6ee8320857b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.303236 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad4d6-27da-4406-8e51-6ee8320857b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.303504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ad4d6-27da-4406-8e51-6ee8320857b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.304164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ad4d6-27da-4406-8e51-6ee8320857b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.305771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ad4d6-27da-4406-8e51-6ee8320857b3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.316202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1364/2723] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:18.320675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.330761 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ffc4-e790-4955-ad05-efca99481a17 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.335269 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.335899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.336205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.336476 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] PATH_INFO: `/v3/projects/f483fe9ef3e547e2a5ba246447fedde2/users/2b38a5bc1e3b4d7a94b9725fd3d9e6ec/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.338356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f483fe9ef3e547e2a5ba246447fedde2, user_id=2b38a5bc1e3b4d7a94b9725fd3d9e6ec, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.341021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.350775 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1360/2724] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:18 2022] PUT /identity/v3/projects/f483fe9ef3e547e2a5ba246447fedde2/users/2b38a5bc1e3b4d7a94b9725fd3d9e6ec/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:18.361289 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02034405-4088-4350-889e-1fb37531276c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.361569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02034405-4088-4350-889e-1fb37531276c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.361840 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02034405-4088-4350-889e-1fb37531276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.389973 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-02034405-4088-4350-889e-1fb37531276c None None] MFA Rules not processed for user `2b38a5bc1e3b4d7a94b9725fd3d9e6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:18.391129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-02034405-4088-4350-889e-1fb37531276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:18.458183 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1365/2725] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:18.469704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.471440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:18.528061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd682-5759-4c9b-a736-7925a45df29d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.532246 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.532843 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.533124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.533395 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.543628 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.545097 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.555055 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1361/2726] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:18.700568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02034405-4088-4350-889e-1fb37531276c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:18.710034 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02034405-4088-4350-889e-1fb37531276c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:18.713563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d30698-d964-4e90-9924-7b201eeb09ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:18.714155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d30698-d964-4e90-9924-7b201eeb09ec service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:18.714430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d30698-d964-4e90-9924-7b201eeb09ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:18.714697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d30698-d964-4e90-9924-7b201eeb09ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:18.771357 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d30698-d964-4e90-9924-7b201eeb09ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:18.772817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d30698-d964-4e90-9924-7b201eeb09ec service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:18.782148 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1366/2727] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:22.532555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:22.533944 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:22.559539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:22.598002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a15b-3678-470a-8fb2-fda77f3258cb service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:22.602551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:22.603162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:22.603435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:22.603706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] PATH_INFO: `/v3/users/a5a15143d36e41209c420d6df1a58824` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:22.604835 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a15143d36e41209c420d6df1a58824)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:22.606714 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:22.651507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a15143d36e41209c420d6df1a58824'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:22.658189 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a15143d36e41209c420d6df1a58824'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:22.658814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a15143d36e41209c420d6df1a58824'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:22.665756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a15143d36e41209c420d6df1a58824'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:22.678041 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a15143d36e41209c420d6df1a58824'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:22.683826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1362/2728] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:22 2022] DELETE /identity/v3/users/a5a15143d36e41209c420d6df1a58824 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:22.688842 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:22.689312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:22.689428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:22.707810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:22.709017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:22.749894 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:22.767625 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1367/2729] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:22.777086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:22.778534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:22.859631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb310d3b-831e-40d4-95af-9d940f943e4e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:22.863995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09cc78-ac92-4e68-8d74-32b40f85288a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:22.865229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cc78-ac92-4e68-8d74-32b40f85288a service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:22.865229 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cc78-ac92-4e68-8d74-32b40f85288a service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:22.865728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09cc78-ac92-4e68-8d74-32b40f85288a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:22.877699 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09cc78-ac92-4e68-8d74-32b40f85288a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:22.879046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09cc78-ac92-4e68-8d74-32b40f85288a service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:22.897675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1363/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:23.266972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.268593 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:23.283523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2563861-2fac-4cb7-9e70-10fe8adc0da5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.290486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.290994 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.291303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.291575 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] PATH_INFO: `/v3/projects/e6316f8e978448eb85cddeff084067f5` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.293047 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6316f8e978448eb85cddeff084067f5)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.294989 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.342384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6316f8e978448eb85cddeff084067f5', 'request_id': 'req-155ae21f-d212-4a7e-8c0a-3a966542849c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:23.350012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6316f8e978448eb85cddeff084067f5', 'request_id': 'req-155ae21f-d212-4a7e-8c0a-3a966542849c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:23.356005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6316f8e978448eb85cddeff084067f5', 'request_id': 'req-155ae21f-d212-4a7e-8c0a-3a966542849c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:23.367310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] The token cache is being invalidate because project e6316f8e978448eb85cddeff084067f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:23.367602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:23.368254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-155ae21f-d212-4a7e-8c0a-3a966542849c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:23.370006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1368/2731] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:23 2022] DELETE /identity/v3/projects/e6316f8e978448eb85cddeff084067f5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:23.374823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.375113 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.375391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.395696 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:23.397086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:23.437928 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:23.458755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1364/2732] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:23.468147 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.468515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.468854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.489296 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:23.490596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:23.498962 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1369/2733] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:23.503257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.512965 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a528657-38af-46c2-93fe-0681f3be93c6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.518411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.519005 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.519278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.519541 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.520268 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:23.520566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.522186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.534248 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1365/2734] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:23.538535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.547833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fff243-8440-4763-937e-1b6e7cb83909 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.553135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.553737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.554011 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.554278 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.554946 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.557013 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.583380 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1370/2735] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:23.587678 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.598012 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1bfd-854b-485b-b789-7328f647d376 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.652337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.652936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.653212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.653484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.654114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.656667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.677033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1366/2736] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:23 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:23.681043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.691807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430657e0-1b68-494f-8ed5-8c6585bd255e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.696417 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.697008 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.697308 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.697563 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.698196 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.699761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.710069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1371/2737] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:23.713818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.723655 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9f04-7d22-4a40-a86f-4a21d3248910 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.728288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617407-90af-4a30-812b-507ff570c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.728939 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617407-90af-4a30-812b-507ff570c8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.729230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617407-90af-4a30-812b-507ff570c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.729505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617407-90af-4a30-812b-507ff570c8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.730190 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617407-90af-4a30-812b-507ff570c8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.732076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617407-90af-4a30-812b-507ff570c8e0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.742565 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1367/2738] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:23.746677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.758096 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2b52e-0781-483c-a16f-5e9a6e17d39b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.762693 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.763327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.763599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.763866 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] PATH_INFO: `/v3/projects/e50045802d9e449aaacc40df2994567b/users/ae1a1721b0f0403ea6d31b0b800d927b/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.778568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50045802d9e449aaacc40df2994567b, user_id=ae1a1721b0f0403ea6d31b0b800d927b, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.781328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.794078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1372/2739] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:23 2022] PUT /identity/v3/projects/e50045802d9e449aaacc40df2994567b/users/ae1a1721b0f0403ea6d31b0b800d927b/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:23.804337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.804560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.804836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.833030 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] MFA Rules not processed for user `ae1a1721b0f0403ea6d31b0b800d927b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:23.834226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:23.896086 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1368/2740] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:23.907149 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:23.908863 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:23.970025 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2b1e-b5ab-4765-9c9a-097cecae8f33 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:23.973903 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:23.974545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:23.974822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:23.975098 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:23.985808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:23.987427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:23.997226 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1373/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:24.026357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:24.069281 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:24.070176 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:24.070727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.082364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:24.093809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c5195-19ef-488a-8557-7a4ea25ba3a1 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:24.098536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:24.099175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.099443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.099716 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] PATH_INFO: `/v3/users/ae1a1721b0f0403ea6d31b0b800d927b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.100955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1a1721b0f0403ea6d31b0b800d927b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:24.102866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:24.141780 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f51dea-1bcc-4742-a29a-7bd4907dd767 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:24.146672 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:24.147299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.147581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.147854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] PATH_INFO: `/v3/users/67be98615c2440e38fe75aa2e52118f2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.149061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67be98615c2440e38fe75aa2e52118f2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:24.150969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:24.151207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1a1721b0f0403ea6d31b0b800d927b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.158741 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1a1721b0f0403ea6d31b0b800d927b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.159404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1a1721b0f0403ea6d31b0b800d927b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.166589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1a1721b0f0403ea6d31b0b800d927b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.180278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21f4540c-3442-45bc-aa25-b24d5257b14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1a1721b0f0403ea6d31b0b800d927b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.187871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1369/2742] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:24 2022] DELETE /identity/v3/users/ae1a1721b0f0403ea6d31b0b800d927b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:24.192272 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.192563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.192953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.199783 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67be98615c2440e38fe75aa2e52118f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.208705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67be98615c2440e38fe75aa2e52118f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.209390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67be98615c2440e38fe75aa2e52118f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.215358 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:24.216589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.216786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67be98615c2440e38fe75aa2e52118f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.228904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-65aa9643-d863-4d3e-9caa-07708d2141b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67be98615c2440e38fe75aa2e52118f2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.236502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1374/2743] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:24 2022] DELETE /identity/v3/users/67be98615c2440e38fe75aa2e52118f2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:24.240741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.241429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.241700 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.260846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:24.262038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.276073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1370/2744] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:24.285740 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:24.287056 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.324168 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1375/2745] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:24.334288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:24.335747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.344615 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a380-1157-4e77-a0fe-d2f7b6974fe9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:24.357167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:24.372242 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:24.401028 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029c6d4-1507-4555-9d59-54bb04b28960 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:24.401607 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:24.402206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.402482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.402751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.404586 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:24.405987 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.406475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.406822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.412365 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:24.413793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:24.416546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:24.418026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:24.424186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1371/2746] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:24.428656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1376/2747] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:24.888994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:24.891127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.895873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:24.897336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:24.910618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490d2c9-47f6-4c1e-bfd4-c4ee9bc202f8 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:24.913152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3bfac-eba7-4ad6-b5ca-d5e079dffc5d service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:24.915526 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:24.916201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.916482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.916755 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] PATH_INFO: `/v3/projects/ae730a154f7a464ba5ff963569f9f063` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.917900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae730a154f7a464ba5ff963569f9f063)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:24.918159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:24.918806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:24.919133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:24.919404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] PATH_INFO: `/v3/projects/e50045802d9e449aaacc40df2994567b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:24.919794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:24.920591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50045802d9e449aaacc40df2994567b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:24.922452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:24.985009 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae730a154f7a464ba5ff963569f9f063', 'request_id': 'req-391572b4-0e57-44f1-b859-97f6aca4b606'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.991070 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50045802d9e449aaacc40df2994567b', 'request_id': 'req-c32a8d1a-e7d3-4455-b141-c23e41ba119e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:24.994556 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae730a154f7a464ba5ff963569f9f063', 'request_id': 'req-391572b4-0e57-44f1-b859-97f6aca4b606'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.000453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50045802d9e449aaacc40df2994567b', 'request_id': 'req-c32a8d1a-e7d3-4455-b141-c23e41ba119e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.001238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae730a154f7a464ba5ff963569f9f063', 'request_id': 'req-391572b4-0e57-44f1-b859-97f6aca4b606'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.006581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50045802d9e449aaacc40df2994567b', 'request_id': 'req-c32a8d1a-e7d3-4455-b141-c23e41ba119e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.013653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] The token cache is being invalidate because project ae730a154f7a464ba5ff963569f9f063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:25.013958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.015081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.016598 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1372/2748] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:24 2022] DELETE /identity/v3/projects/ae730a154f7a464ba5ff963569f9f063 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:25.020377 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.021731 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.021874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] The token cache is being invalidate because project e50045802d9e449aaacc40df2994567b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:25.022067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.022691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32a8d1a-e7d3-4455-b141-c23e41ba119e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.024188 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1377/2749] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:24 2022] DELETE /identity/v3/projects/e50045802d9e449aaacc40df2994567b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:25.031746 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6527-aec8-4c99-9255-8f9ad9bc6775 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.032062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6527-aec8-4c99-9255-8f9ad9bc6775 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.032336 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6527-aec8-4c99-9255-8f9ad9bc6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.051355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5edc6527-aec8-4c99-9255-8f9ad9bc6775 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:25.052703 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5edc6527-aec8-4c99-9255-8f9ad9bc6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.088535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391572b4-0e57-44f1-b859-97f6aca4b606 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.116075 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1378/2750] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:25.123772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.124091 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.124365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.136266 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:25.144505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:25.145829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.151201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.151823 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.152132 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.152403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] PATH_INFO: `/v3/users/2b38a5bc1e3b4d7a94b9725fd3d9e6ec` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.153538 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b38a5bc1e3b4d7a94b9725fd3d9e6ec)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.153754 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1379/2751] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:25.156139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.158504 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.169955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f049ec-4ac1-40f0-a66e-9cd8a9e9602f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.171878 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.172491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.172769 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.173041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.173681 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:25.173979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.175553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.188002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1380/2752] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:25.193049 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.206623 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b38a5bc1e3b4d7a94b9725fd3d9e6ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.207545 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde6dd-a12d-4f9b-b60c-065234c4c785 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.213469 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.213713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b38a5bc1e3b4d7a94b9725fd3d9e6ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.214340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.214462 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b38a5bc1e3b4d7a94b9725fd3d9e6ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.214626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.214902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.215536 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.217480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.221648 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b38a5bc1e3b4d7a94b9725fd3d9e6ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.234144 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b38a5bc1e3b4d7a94b9725fd3d9e6ec'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.240537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1373/2753] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:25 2022] DELETE /identity/v3/users/2b38a5bc1e3b4d7a94b9725fd3d9e6ec => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:25.244602 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1381/2754] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:25.249060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.250435 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.321866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05078376-f283-4c85-bca5-a5eefa4a4c00 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.379747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.380605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.380933 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.381238 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.381862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.383803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.407405 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1374/2755] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:25.411483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.422120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5f3cd-87fd-44a2-9484-a04225c21202 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.426817 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.427424 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.427697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.428002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.428664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.430257 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.441515 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1382/2756] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:25.445815 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.452812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:25.457372 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192703-e254-456e-95ed-66480c7c7cc9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.463243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.463887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.464375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.464800 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.465495 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.467114 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.478288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1375/2757] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:25.482348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.487814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:25.496304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4b48b-6f19-4954-8b4c-8392f451068e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.503201 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a142eb-1d98-47f2-b87a-7203cc194634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.503882 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a142eb-1d98-47f2-b87a-7203cc194634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.504332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a142eb-1d98-47f2-b87a-7203cc194634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.504605 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a142eb-1d98-47f2-b87a-7203cc194634 admin admin] PATH_INFO: `/v3/projects/1c9df0572320477f9b88f95c6aec89e8/users/8f7addc6a350438799ad015f175c7965/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.520682 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.521267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a142eb-1d98-47f2-b87a-7203cc194634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9df0572320477f9b88f95c6aec89e8, user_id=8f7addc6a350438799ad015f175c7965, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.522542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.523983 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a142eb-1d98-47f2-b87a-7203cc194634 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.536932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f479c7-22f0-49a1-9cc0-a407c78af000 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.541171 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1383/2758] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:25 2022] PUT /identity/v3/projects/1c9df0572320477f9b88f95c6aec89e8/users/8f7addc6a350438799ad015f175c7965/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:25.554868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.555164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.555636 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.586410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] MFA Rules not processed for user `8f7addc6a350438799ad015f175c7965`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:25.587652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.604073 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.604705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.604980 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.605257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] PATH_INFO: `/v3/projects/f483fe9ef3e547e2a5ba246447fedde2` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.606382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f483fe9ef3e547e2a5ba246447fedde2)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.608825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.654810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f483fe9ef3e547e2a5ba246447fedde2', 'request_id': 'req-eada26e8-7d61-4fca-a3c4-2565334dfad7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.656135 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1384/2759] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:25.667421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f483fe9ef3e547e2a5ba246447fedde2', 'request_id': 'req-eada26e8-7d61-4fca-a3c4-2565334dfad7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.668051 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.669519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.674314 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f483fe9ef3e547e2a5ba246447fedde2', 'request_id': 'req-eada26e8-7d61-4fca-a3c4-2565334dfad7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.685780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] The token cache is being invalidate because project f483fe9ef3e547e2a5ba246447fedde2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:25.686632 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.687309 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-eada26e8-7d61-4fca-a3c4-2565334dfad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:25.689067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1376/2760] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:25 2022] DELETE /identity/v3/projects/f483fe9ef3e547e2a5ba246447fedde2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:25.693725 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8658-f605-4729-9eb5-77c876e6f91b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.694007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8658-f605-4729-9eb5-77c876e6f91b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.694284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8658-f605-4729-9eb5-77c876e6f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.713333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2ddf8658-f605-4729-9eb5-77c876e6f91b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:25.714529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2ddf8658-f605-4729-9eb5-77c876e6f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.728609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486d809-1e05-40d2-8d69-4fff8e55e888 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.774749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1377/2761] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:25.777834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.778435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.778724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.778976 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.780738 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.782227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.782521 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.782797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.804609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:25.805814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:25.814604 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1378/2762] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:25.818747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.821753 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:25.828094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e63413-b94e-4dde-ac15-b1a224b67859 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.832984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.833562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.833834 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.834100 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.834720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:25.835015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.836715 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.842725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.844213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.848076 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1379/2763] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:39:25.852225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.853539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1385/2764] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:25.865570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:25.865570 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e1a16-ac72-485d-9dd6-2268be5ebc06 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.872177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.873413 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.875035 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.875525 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.876737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.879297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:25.909049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1380/2765] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:25.913120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:25.924697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972838-9078-480d-a994-9146a97edde6 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:25.983685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:25.984581 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:25.984949 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:25.985142 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:25.985764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:25.987851 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.012486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1386/2766] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:25 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:26.016290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.028164 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ca23b-c747-42ec-b1af-f0d95cd4b70f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.034794 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.035468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.035782 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.036177 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.036723 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.038327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.050107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1381/2767] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:26.054251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.066048 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276f7cc-ad9e-40ca-ab21-286e86addd29 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.072819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfef32-8347-4c36-9b41-2e2f45831b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.073431 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfef32-8347-4c36-9b41-2e2f45831b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.073810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfef32-8347-4c36-9b41-2e2f45831b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.074038 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfef32-8347-4c36-9b41-2e2f45831b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.075227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfef32-8347-4c36-9b41-2e2f45831b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.076890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfef32-8347-4c36-9b41-2e2f45831b64 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.090152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1387/2768] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:26.095537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.107967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757ca7-24ab-4e34-be14-6d0049221a7b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.117625 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.118421 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.118786 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.118972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] PATH_INFO: `/v3/projects/3ccbf891b3344623a52331dadc9aa0b4/users/9a02939c084446ba94e8f95f353b902f/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.143069 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccbf891b3344623a52331dadc9aa0b4, user_id=9a02939c084446ba94e8f95f353b902f, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.147074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.176216 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1382/2769] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:26 2022] PUT /identity/v3/projects/3ccbf891b3344623a52331dadc9aa0b4/users/9a02939c084446ba94e8f95f353b902f/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:26.250796 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.251087 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.251365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.279140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] MFA Rules not processed for user `9a02939c084446ba94e8f95f353b902f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:26.281035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:26.353263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1388/2770] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:26.357846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.428974 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cafd05-57b7-4248-b177-e4c9c53044e6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.434406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.435345 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.435799 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.436302 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.437426 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.440709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.474179 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1383/2771] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:26 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:26.475302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.486039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095afe-8b27-48f8-bdf7-05cbcead2d0e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.490079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.492193 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:26.531689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:26.545434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.546161 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.546445 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.546718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.547349 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.549325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.549948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63cd1d-1efa-4026-8154-885d78a0c79c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.553675 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.554273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.554551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.554826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.556566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:26.571073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1389/2772] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:26 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:26.574776 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.584899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc67a9-f988-4eef-9b12-299623c40015 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.589476 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.590055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.590329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.590594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.591223 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.593808 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.603553 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1390/2773] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:26.605496 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:26.607909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.617286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b21f-bdc6-4467-96ed-66f4f9a7d64c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.622044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.622659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.622933 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.623200 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] PATH_INFO: `/v3/projects/d59589c2cde540669bc2eab9641dd150/users/2cffb403f2e940fba18777a1a48a673e/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.631771 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.633261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.637487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59589c2cde540669bc2eab9641dd150, user_id=2cffb403f2e940fba18777a1a48a673e, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.640639 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.645175 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1384/2774] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:26.653831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1391/2775] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:26 2022] PUT /identity/v3/projects/d59589c2cde540669bc2eab9641dd150/users/2cffb403f2e940fba18777a1a48a673e/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:26.659603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.669852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12b8fc-2782-4a60-8817-989fdc2183f1 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.730080 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5dc9-54d2-420d-8c53-59331103f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.730685 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5dc9-54d2-420d-8c53-59331103f809 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.730958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5dc9-54d2-420d-8c53-59331103f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.731222 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5dc9-54d2-420d-8c53-59331103f809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.732146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e5dc9-54d2-420d-8c53-59331103f809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.733650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e5dc9-54d2-420d-8c53-59331103f809 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.743909 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1385/2776] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:26.748339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.758907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb87cdd-b93e-4f84-8861-10e343e2a1f5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.763683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.765005 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.765348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.765683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] PATH_INFO: `/v3/projects/d59589c2cde540669bc2eab9641dd150/users/2cffb403f2e940fba18777a1a48a673e/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.767682 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59589c2cde540669bc2eab9641dd150, user_id=2cffb403f2e940fba18777a1a48a673e, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.770396 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.781919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1392/2777] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:26 2022] PUT /identity/v3/projects/d59589c2cde540669bc2eab9641dd150/users/2cffb403f2e940fba18777a1a48a673e/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:26.792166 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.792448 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.792719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.820840 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] MFA Rules not processed for user `2cffb403f2e940fba18777a1a48a673e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:26.822022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:26.891576 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1386/2778] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:26.904644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:26.909176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:26.970032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f3a13-8ed9-4045-8c25-fa0eea6af28b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:26.973648 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:26.974251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:26.974561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:26.974833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:26.984919 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:26.986658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:26.997475 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1393/2779] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:27.080411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:27.089958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac7ac6-d165-400c-acb9-794e6c444695 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:27.093562 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dca3e4-f1b4-4c04-b83c-7024030f46ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:27.094188 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dca3e4-f1b4-4c04-b83c-7024030f46ed service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:27.094493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dca3e4-f1b4-4c04-b83c-7024030f46ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:27.094768 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dca3e4-f1b4-4c04-b83c-7024030f46ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:27.148637 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:27.152876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dca3e4-f1b4-4c04-b83c-7024030f46ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:27.154335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dca3e4-f1b4-4c04-b83c-7024030f46ed service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:27.163094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1387/2780] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:32.085647 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:32.157263 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451667-fb76-40f2-ad23-38e4f98ad70d service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:32.161937 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:32.162561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:32.162834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:32.163104 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] PATH_INFO: `/v3/users/9a02939c084446ba94e8f95f353b902f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:32.164246 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a02939c084446ba94e8f95f353b902f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:32.166132 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:32.205547 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:32.228766 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a02939c084446ba94e8f95f353b902f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.237760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a02939c084446ba94e8f95f353b902f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.238415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a02939c084446ba94e8f95f353b902f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.246163 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a02939c084446ba94e8f95f353b902f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.258992 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a02939c084446ba94e8f95f353b902f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.269747 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1394/2781] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:32 2022] DELETE /identity/v3/users/9a02939c084446ba94e8f95f353b902f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:32.274254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:32.274737 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:32.274938 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:32.294062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:32.295299 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:32.353530 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1388/2782] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:32.364330 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:32.365735 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:32.427151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d31e5-9edb-45d8-8d8f-7423a1c4fcc8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:32.430702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:32.431303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:32.431845 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:32.432152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:32.441191 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:32.442601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:32.452570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1395/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:32.727039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:32.728473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:32.743091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e583-f67e-4e4a-92dd-3a4d66feb0aa None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:32.749563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:32.750101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:32.750369 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:32.750629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] PATH_INFO: `/v3/projects/3ccbf891b3344623a52331dadc9aa0b4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:32.752048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ccbf891b3344623a52331dadc9aa0b4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:32.754340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:32.804359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccbf891b3344623a52331dadc9aa0b4', 'request_id': 'req-77908bd7-b562-4de8-8dee-90ee0d2d1231'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.813257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccbf891b3344623a52331dadc9aa0b4', 'request_id': 'req-77908bd7-b562-4de8-8dee-90ee0d2d1231'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.818899 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccbf891b3344623a52331dadc9aa0b4', 'request_id': 'req-77908bd7-b562-4de8-8dee-90ee0d2d1231'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.830851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] The token cache is being invalidate because project 3ccbf891b3344623a52331dadc9aa0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:32.831139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.831857 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.836061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1389/2784] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:32 2022] DELETE /identity/v3/projects/3ccbf891b3344623a52331dadc9aa0b4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:32.839947 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:32.849603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ca6e-02b0-43e6-99ac-48d250707992 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:32.908170 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:32.908786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:32.909061 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:32.909329 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] PATH_INFO: `/v3/users/2cffb403f2e940fba18777a1a48a673e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:32.910434 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cffb403f2e940fba18777a1a48a673e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:32.912362 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:32.959707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cffb403f2e940fba18777a1a48a673e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.968795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cffb403f2e940fba18777a1a48a673e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.969626 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cffb403f2e940fba18777a1a48a673e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.971791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:32.980839 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cffb403f2e940fba18777a1a48a673e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:32.994924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cffb403f2e940fba18777a1a48a673e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:33.002230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1396/2785] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:32 2022] DELETE /identity/v3/users/2cffb403f2e940fba18777a1a48a673e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:33.382260 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.384339 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:33.387505 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.389080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:33.395554 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77908bd7-b562-4de8-8dee-90ee0d2d1231 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.457704 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42284cd-ffbd-40e0-ae46-525d067deabb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.460849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.461231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.461633 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.461834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.461984 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.462103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.462257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] PATH_INFO: `/v3/projects/d59589c2cde540669bc2eab9641dd150` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.462366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.463557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59589c2cde540669bc2eab9641dd150)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.464079 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:33.465490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.477725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.479155 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf682-0645-4eb7-9c21-3838cf6aa0f4 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.488046 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:33.490535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1397/2786] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:33.516105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59589c2cde540669bc2eab9641dd150', 'request_id': 'req-29e6ddec-47e1-4737-bacd-f2bbace65c41'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:33.523808 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59589c2cde540669bc2eab9641dd150', 'request_id': 'req-29e6ddec-47e1-4737-bacd-f2bbace65c41'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:33.529522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59589c2cde540669bc2eab9641dd150', 'request_id': 'req-29e6ddec-47e1-4737-bacd-f2bbace65c41'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:33.541397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] The token cache is being invalidate because project d59589c2cde540669bc2eab9641dd150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:33.541763 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:33.542409 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-29e6ddec-47e1-4737-bacd-f2bbace65c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:33.544227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1390/2787] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:33 2022] DELETE /identity/v3/projects/d59589c2cde540669bc2eab9641dd150 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:33.549734 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.550017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.550286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.569729 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:33.570920 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:33.635465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1398/2788] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:33.644368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.644981 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.645261 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.665257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:33.666472 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:33.675353 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1391/2789] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:33.679719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.689561 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a56fd-7edf-4df2-8217-5ea3dd822e3c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.694565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.695182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.695462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.695732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.696427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:33.696733 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.698313 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.710312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1399/2790] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:33.714746 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.724536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740edb29-b047-405b-af1c-3b2ae70a8696 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.729241 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.729833 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.730105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.730370 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.731194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.733644 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.765573 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1392/2791] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:33 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:33.766815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.777701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53ff07-afd3-4b06-b6a3-92c327d56de7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.835151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.835739 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.836046 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.836317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.836941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.838926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.849062 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:33.864164 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1400/2792] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:33 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:33.867783 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.884837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b642e9-1770-4bfa-ae9a-cf290ac54138 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.891106 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.891600 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.891877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.892184 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.892828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.894586 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.905744 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1393/2793] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:33.910335 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.923688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc60212-4886-43e1-858b-615627fe1a3a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.929089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471575d-3aca-4d97-afa3-fcba40e58d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.929679 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471575d-3aca-4d97-afa3-fcba40e58d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.930052 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471575d-3aca-4d97-afa3-fcba40e58d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.930508 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471575d-3aca-4d97-afa3-fcba40e58d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.931275 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471575d-3aca-4d97-afa3-fcba40e58d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.933037 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471575d-3aca-4d97-afa3-fcba40e58d5e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:33.947970 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1401/2794] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:33.950854 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:33.962659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c297fd-3c43-420f-8c24-931de333f6aa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:33.968254 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:33.968998 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:33.969506 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:33.969869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] PATH_INFO: `/v3/projects/334775d05e9e477698b36a784d186661/users/5208874750004101aac8e35c5cc6ad78/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:33.985376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=334775d05e9e477698b36a784d186661, user_id=5208874750004101aac8e35c5cc6ad78, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:33.988108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.002514 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1394/2795] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:33 2022] PUT /identity/v3/projects/334775d05e9e477698b36a784d186661/users/5208874750004101aac8e35c5cc6ad78/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:34.013378 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.013741 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.014555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.042629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] MFA Rules not processed for user `5208874750004101aac8e35c5cc6ad78`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:34.043871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:34.108787 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1402/2796] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:34.113098 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.175283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57ed42-603e-4df3-9d9d-ab863abede2b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.179915 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.180477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.180750 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.181017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.181645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.183518 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.223347 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1395/2797] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:34 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:34.227426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.238534 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6011b7-18a9-415f-976e-3ea932ce793b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.299795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.300542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.300925 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.301299 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.302043 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.304216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.329019 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1403/2798] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:34 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:34.334221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.346220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4bdc8-895b-45d5-9afa-3aa1c2f7d216 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.351505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.353850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.354555 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.355066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.356218 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.358130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.379271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.385423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1396/2799] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:34.393159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196536a-8953-47d9-a7df-8b942c22fd2a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.398462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.399203 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.399531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.399897 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] PATH_INFO: `/v3/projects/edb38b9893094b81a14ce68cc9de2b92/users/b5afe7821fcd40fc8f08fe0f2912077a/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.418956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb38b9893094b81a14ce68cc9de2b92, user_id=b5afe7821fcd40fc8f08fe0f2912077a, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.422213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.443056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1404/2800] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:34 2022] PUT /identity/v3/projects/edb38b9893094b81a14ce68cc9de2b92/users/b5afe7821fcd40fc8f08fe0f2912077a/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:34.448381 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.460121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62181c6-6fc9-4970-bc15-48207083cf35 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.478143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:34.533960 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c17c9c-3737-43a9-8489-22855c0fb831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.534595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c17c9c-3737-43a9-8489-22855c0fb831 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.534950 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c17c9c-3737-43a9-8489-22855c0fb831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.535128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c17c9c-3737-43a9-8489-22855c0fb831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.535829 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c17c9c-3737-43a9-8489-22855c0fb831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.537571 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c17c9c-3737-43a9-8489-22855c0fb831 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.564210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1397/2801] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:34.568360 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.581270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40c276-01dd-4d77-86c2-89752280890b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.585911 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.586836 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.587177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.587608 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] PATH_INFO: `/v3/projects/edb38b9893094b81a14ce68cc9de2b92/users/b5afe7821fcd40fc8f08fe0f2912077a/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.589653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb38b9893094b81a14ce68cc9de2b92, user_id=b5afe7821fcd40fc8f08fe0f2912077a, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.593055 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.604550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1405/2802] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:34 2022] PUT /identity/v3/projects/edb38b9893094b81a14ce68cc9de2b92/users/b5afe7821fcd40fc8f08fe0f2912077a/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:34.615316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.615672 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.618121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.647252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] MFA Rules not processed for user `b5afe7821fcd40fc8f08fe0f2912077a`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:34.648677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:34.721427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1398/2803] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:34.732387 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:34.734353 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:34.770654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:34.809197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a33ca7-a4c9-44d0-b7d0-c40a5bcef6bb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:34.814529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd8de-aa25-4936-9d48-0bb639c400bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:34.815282 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd8de-aa25-4936-9d48-0bb639c400bc service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:34.815622 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd8de-aa25-4936-9d48-0bb639c400bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:34.815979 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd8de-aa25-4936-9d48-0bb639c400bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:34.881665 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd8de-aa25-4936-9d48-0bb639c400bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:34.883151 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd8de-aa25-4936-9d48-0bb639c400bc service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:34.892364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1406/2804] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:36.176440 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:36.177941 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:36.257478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652701c-9b7b-47f4-87d4-f1085ecf563e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:36.263087 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:36.265124 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:36.266362 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:36.266927 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] PATH_INFO: `/v3/users/8f7addc6a350438799ad015f175c7965` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:36.268356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7addc6a350438799ad015f175c7965)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:36.270533 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:36.332020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:36.339897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7addc6a350438799ad015f175c7965'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:36.350206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7addc6a350438799ad015f175c7965'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:36.350963 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7addc6a350438799ad015f175c7965'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:36.377717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7addc6a350438799ad015f175c7965'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:36.399558 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7addc6a350438799ad015f175c7965'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:36.410411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1399/2805] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:36 2022] DELETE /identity/v3/users/8f7addc6a350438799ad015f175c7965 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:36.416899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:36.417426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:36.417426 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:36.443752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:36.444587 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:36.551115 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1407/2806] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:36.564264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:36.565535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:36.660609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803d42c-99af-4e27-a2eb-f1a0184dd62d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:36.665877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:36.667017 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:36.667196 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:36.667467 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:36.683021 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:36.684711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:36.726033 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1400/2807] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:36.923502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:36.925050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.007922 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.009432 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.029337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef78bf-f4c4-4046-81da-3433787a5887 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.036722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.037368 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.037639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.037904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] PATH_INFO: `/v3/users/b8c15490fa2b4c16accaa316a043795b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.039022 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5faa9-9c7f-4234-b983-5d50d28abe79 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.044568 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.045192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.046035 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.046323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.048494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.053929 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c15490fa2b4c16accaa316a043795b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.055856 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.063277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.064930 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.075591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1408/2808] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:37.095304 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.096827 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.122232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c15490fa2b4c16accaa316a043795b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.124526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071192-a05d-4dd8-852b-fc87f7a01a39 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.131887 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.132518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.132825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.133027 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c15490fa2b4c16accaa316a043795b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.133213 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] PATH_INFO: `/v3/projects/1c9df0572320477f9b88f95c6aec89e8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.133653 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c15490fa2b4c16accaa316a043795b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.134514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9df0572320477f9b88f95c6aec89e8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.137069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.138779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:37.141825 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c15490fa2b4c16accaa316a043795b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.155760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c15490fa2b4c16accaa316a043795b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.161881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1401/2809] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:37 2022] DELETE /identity/v3/users/b8c15490fa2b4c16accaa316a043795b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:37.189486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9df0572320477f9b88f95c6aec89e8', 'request_id': 'req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.205450 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9df0572320477f9b88f95c6aec89e8', 'request_id': 'req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.214708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9df0572320477f9b88f95c6aec89e8', 'request_id': 'req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.227012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] The token cache is being invalidate because project 1c9df0572320477f9b88f95c6aec89e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:37.227302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.228069 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-44f5b5d6-bc14-44a1-a58a-828e0e565ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.229760 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1409/2810] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:37 2022] DELETE /identity/v3/projects/1c9df0572320477f9b88f95c6aec89e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:37.356401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.358802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.393038 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:37.438289 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26421b3-581a-4b91-bed3-128107dd99bd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.498887 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.499512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.499793 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.500111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] PATH_INFO: `/v3/projects/4ca2bb10120543108bf8d2e5e51f1979` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.511011 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca2bb10120543108bf8d2e5e51f1979)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.512970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.564305 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca2bb10120543108bf8d2e5e51f1979', 'request_id': 'req-51ae4611-b1e6-4bdd-9de5-06b531c660c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.572204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca2bb10120543108bf8d2e5e51f1979', 'request_id': 'req-51ae4611-b1e6-4bdd-9de5-06b531c660c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.578760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca2bb10120543108bf8d2e5e51f1979', 'request_id': 'req-51ae4611-b1e6-4bdd-9de5-06b531c660c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.590461 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] The token cache is being invalidate because project 4ca2bb10120543108bf8d2e5e51f1979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:37.590752 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.591397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.593484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1402/2811] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:37 2022] DELETE /identity/v3/projects/4ca2bb10120543108bf8d2e5e51f1979 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:37.598255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c592f-1361-4f78-9886-bb8f0b79da3a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.598764 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c592f-1361-4f78-9886-bb8f0b79da3a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.598865 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c592f-1361-4f78-9886-bb8f0b79da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.620366 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-438c592f-1361-4f78-9886-bb8f0b79da3a None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:37.621590 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-438c592f-1361-4f78-9886-bb8f0b79da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.634065 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.635473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.688691 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1410/2812] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:37.690592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:37.696617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.696909 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.697189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.705226 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae4611-b1e6-4bdd-9de5-06b531c660c8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.710779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.711412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.711688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.711988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] PATH_INFO: `/v3/users/5208874750004101aac8e35c5cc6ad78` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.713128 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5208874750004101aac8e35c5cc6ad78)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.715089 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.717790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:37.719007 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.726786 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1411/2813] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:37.730977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.739705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61abdb-2491-404a-920d-42f6dac74c49 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.745254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.745868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.746127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.746399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.747086 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:37.747425 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.749080 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.764714 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1412/2814] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:39:37.765157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5208874750004101aac8e35c5cc6ad78'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.765599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.772957 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5208874750004101aac8e35c5cc6ad78'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.773651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5208874750004101aac8e35c5cc6ad78'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.775725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d158b9d-bb77-4718-926a-f661ccb87071 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.781026 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.781603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5208874750004101aac8e35c5cc6ad78'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.781724 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.781880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.782152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.782781 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.784687 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.794207 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e89118f4-962a-4027-8b3c-cd366926cfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5208874750004101aac8e35c5cc6ad78'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:37.800742 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1403/2815] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:37 2022] DELETE /identity/v3/users/5208874750004101aac8e35c5cc6ad78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:37.805482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fa91-432e-4e94-935d-63186e1955db None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.805729 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fa91-432e-4e94-935d-63186e1955db None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.806002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fa91-432e-4e94-935d-63186e1955db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.815172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1413/2816] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:37 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:37.819391 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.821017 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.825953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7005fa91-432e-4e94-935d-63186e1955db None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:37.828173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7005fa91-432e-4e94-935d-63186e1955db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.872286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:37.889949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1404/2817] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:37.890162 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f836e-8e1b-4179-9965-a0215a789361 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.895365 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.896016 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.896291 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.896552 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.897172 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.899159 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.899609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fa91-432e-4e94-935d-63186e1955db None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.901146 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7005fa91-432e-4e94-935d-63186e1955db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:37.921345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1414/2818] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:37 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:37.925491 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.935124 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20840ce-9cf8-45de-b816-77a681177fde admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.940423 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.941247 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.941532 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.941803 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.942440 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.944498 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.955256 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1415/2819] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:37.959193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:37.961408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fa91-432e-4e94-935d-63186e1955db None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.965066 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.965666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.965953 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.966232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.968978 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46616a4-2828-4380-b62a-226dcdf1193d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:37.973543 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e27a-cd3a-41ce-81b3-30d5b95f6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:37.974111 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e27a-cd3a-41ce-81b3-30d5b95f6830 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:37.974395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e27a-cd3a-41ce-81b3-30d5b95f6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:37.974668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e27a-cd3a-41ce-81b3-30d5b95f6830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:37.975285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.975397 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e27a-cd3a-41ce-81b3-30d5b95f6830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:37.976756 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.977039 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e27a-cd3a-41ce-81b3-30d5b95f6830 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:37.988165 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1405/2820] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:37.992272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1416/2821] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:37.993455 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.004494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647ef41-bd4f-4102-938e-b06c949d7f51 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.009263 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.009917 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.010199 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.010475 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] PATH_INFO: `/v3/projects/cc77b554f82649e19174166bd57aa6d4/users/96ffd55d7fb640058fa91a16389799b6/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.024988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:38.032341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc77b554f82649e19174166bd57aa6d4, user_id=96ffd55d7fb640058fa91a16389799b6, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.036427 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.054724 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1406/2822] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:37 2022] PUT /identity/v3/projects/cc77b554f82649e19174166bd57aa6d4/users/96ffd55d7fb640058fa91a16389799b6/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:38.066791 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.067404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.067891 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.098122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] MFA Rules not processed for user `96ffd55d7fb640058fa91a16389799b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:38.099955 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.181063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1417/2823] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:39:38.185660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.260105 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996a7b0-f139-409a-b727-ef6dbb93a444 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.265313 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.265958 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.266234 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.266504 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.267142 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.269247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.297515 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1407/2824] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:38.301720 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.313368 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b68c-0156-4bbb-bc4b-46b9c1449434 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.317634 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.319844 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.388613 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.389157 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.389430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.389698 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.389822 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53720be-1434-474c-b079-894c54a98474 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.390320 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.392232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.394418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.395047 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.395315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.395605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] PATH_INFO: `/v3/projects/334775d05e9e477698b36a784d186661` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.396749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334775d05e9e477698b36a784d186661)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.398624 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.419535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1418/2825] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:38 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:38.421442 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.431841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91993c58-fa72-470a-8cfb-5bec9928bee4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.437334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.437926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.438208 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.438481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.439127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.440743 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.448411 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334775d05e9e477698b36a784d186661', 'request_id': 'req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.452015 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1419/2826] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:38.455292 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.456804 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334775d05e9e477698b36a784d186661', 'request_id': 'req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.462371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334775d05e9e477698b36a784d186661', 'request_id': 'req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.465252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b9176-acaa-4ee8-9252-2c709fed47f0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.473713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] The token cache is being invalidate because project 334775d05e9e477698b36a784d186661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:38.474224 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.474918 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.476548 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1408/2827] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:38 2022] DELETE /identity/v3/projects/334775d05e9e477698b36a784d186661 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:38.480333 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.481693 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.486514 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:38.489378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:38.525591 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.526283 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.526594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.526885 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] PATH_INFO: `/v3/projects/cf3604667660441d9c897861368af231/users/f04df92ca6b94e9e830fca420c3e3b86/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.541736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3604667660441d9c897861368af231, user_id=f04df92ca6b94e9e830fca420c3e3b86, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.544430 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.552406 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cebf3e-cfb1-4cf2-8a0d-fd94a445f193 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.558187 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1420/2828] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:38 2022] PUT /identity/v3/projects/cf3604667660441d9c897861368af231/users/f04df92ca6b94e9e830fca420c3e3b86/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:38.562635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.564345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.610961 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.611601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.611881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.612187 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] PATH_INFO: `/v3/users/b5afe7821fcd40fc8f08fe0f2912077a` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.613325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5afe7821fcd40fc8f08fe0f2912077a)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.615247 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.633466 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b5cb1-a01c-45f1-90bb-d55213f214a7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.638343 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.639133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.639435 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.639713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.640410 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.642185 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.652683 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1421/2829] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:39:38.657345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.663212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5afe7821fcd40fc8f08fe0f2912077a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.666822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512059-9474-483b-9cff-6ba261d7dc3b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.671711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5afe7821fcd40fc8f08fe0f2912077a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.672484 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5afe7821fcd40fc8f08fe0f2912077a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.672708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24373c-765f-41fd-af31-14407481c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.673473 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24373c-765f-41fd-af31-14407481c92f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.673924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24373c-765f-41fd-af31-14407481c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.674202 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24373c-765f-41fd-af31-14407481c92f admin admin] PATH_INFO: `/v3/projects/cf3604667660441d9c897861368af231/users/f04df92ca6b94e9e830fca420c3e3b86/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.676535 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24373c-765f-41fd-af31-14407481c92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3604667660441d9c897861368af231, user_id=f04df92ca6b94e9e830fca420c3e3b86, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.679193 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24373c-765f-41fd-af31-14407481c92f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.679795 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5afe7821fcd40fc8f08fe0f2912077a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.690653 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1422/2830] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:38 2022] PUT /identity/v3/projects/cf3604667660441d9c897861368af231/users/f04df92ca6b94e9e830fca420c3e3b86/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:38.692849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5afe7821fcd40fc8f08fe0f2912077a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:38.699007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1409/2831] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:38 2022] DELETE /identity/v3/users/b5afe7821fcd40fc8f08fe0f2912077a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:38.702404 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.702569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.702847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.731390 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] MFA Rules not processed for user `f04df92ca6b94e9e830fca420c3e3b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:38.732711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.803384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1423/2832] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:38.815210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.816667 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.853054 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:38.879127 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b1b7-4df4-4671-a929-2902c8167cd9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:38.886031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:38.886873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:38.887278 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:38.887557 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:38.896935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:38.898473 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:38.908734 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1410/2833] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:38.979280 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.980860 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:38.985781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:38.998423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556888-9f28-41aa-b80a-ca914afd354d service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:39.003066 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:39.003284 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:39.004468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:39.004860 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:39.005531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:39.008397 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:39.053841 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e39b31-44c4-4241-8593-50013899b788 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:39.058707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:39.059339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:39.059617 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:39.059893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] PATH_INFO: `/v3/projects/edb38b9893094b81a14ce68cc9de2b92` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:39.061102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb38b9893094b81a14ce68cc9de2b92)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:39.063010 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:39.070669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:39.072147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:39.081470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1411/2834] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:39:39.113659 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb38b9893094b81a14ce68cc9de2b92', 'request_id': 'req-b6be11ac-463c-4ed8-93f2-391a26123ec3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:39.123567 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb38b9893094b81a14ce68cc9de2b92', 'request_id': 'req-b6be11ac-463c-4ed8-93f2-391a26123ec3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:39.129893 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb38b9893094b81a14ce68cc9de2b92', 'request_id': 'req-b6be11ac-463c-4ed8-93f2-391a26123ec3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:39.143409 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] The token cache is being invalidate because project edb38b9893094b81a14ce68cc9de2b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:39.143705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:39.144527 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6be11ac-463c-4ed8-93f2-391a26123ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:39.146032 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1424/2835] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:38 2022] DELETE /identity/v3/projects/edb38b9893094b81a14ce68cc9de2b92 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:45.857912 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:45.859300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:45.872779 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad06680-8e1f-46e1-897d-059a01790a64 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:45.927544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:45.928212 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:45.930340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:45.930627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] PATH_INFO: `/v3/users/96ffd55d7fb640058fa91a16389799b6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:45.931765 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ffd55d7fb640058fa91a16389799b6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:45.933720 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:45.978948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ffd55d7fb640058fa91a16389799b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:45.985884 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ffd55d7fb640058fa91a16389799b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:45.986531 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ffd55d7fb640058fa91a16389799b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:45.993449 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ffd55d7fb640058fa91a16389799b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.001708 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:46.007022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ffd55d7fb640058fa91a16389799b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.013391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1412/2836] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:45 2022] DELETE /identity/v3/users/96ffd55d7fb640058fa91a16389799b6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:46.018471 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:46.018980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:46.019107 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:46.039864 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:46.041129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:46.098452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1425/2837] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:46.108288 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:46.109695 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:46.166478 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc70d79-a3ef-4ba6-a8d1-897be8642424 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:46.170111 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:46.170713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:46.170993 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:46.171264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:46.180300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:46.181728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:46.191382 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1413/2838] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:46.453053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:46.454542 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:46.466519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220357c-b05d-4738-b9d4-d28e30064c7b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:46.471165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:46.471789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:46.472101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:46.472370 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] PATH_INFO: `/v3/projects/cc77b554f82649e19174166bd57aa6d4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:46.473718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc77b554f82649e19174166bd57aa6d4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:46.475652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:46.516082 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:46.522936 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc77b554f82649e19174166bd57aa6d4', 'request_id': 'req-cd78eecf-d764-4b20-b819-fb0d47548f51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.529811 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc77b554f82649e19174166bd57aa6d4', 'request_id': 'req-cd78eecf-d764-4b20-b819-fb0d47548f51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.535363 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc77b554f82649e19174166bd57aa6d4', 'request_id': 'req-cd78eecf-d764-4b20-b819-fb0d47548f51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.546571 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] The token cache is being invalidate because project cc77b554f82649e19174166bd57aa6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:46.546856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.547478 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.548951 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1426/2839] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:46 2022] DELETE /identity/v3/projects/cc77b554f82649e19174166bd57aa6d4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:46.552938 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:46.563078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849fc3-f80e-4633-bdca-c0625a3945af service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:46.618717 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:46.619340 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:46.619617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:46.620178 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] PATH_INFO: `/v3/users/f04df92ca6b94e9e830fca420c3e3b86` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:46.621285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04df92ca6b94e9e830fca420c3e3b86)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:46.623197 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:46.666753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04df92ca6b94e9e830fca420c3e3b86'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.674384 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04df92ca6b94e9e830fca420c3e3b86'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.675067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04df92ca6b94e9e830fca420c3e3b86'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.681947 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04df92ca6b94e9e830fca420c3e3b86'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.694236 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4c6f9a50-656d-47d4-addb-788fd516c538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04df92ca6b94e9e830fca420c3e3b86'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:46.700072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1414/2840] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:46 2022] DELETE /identity/v3/users/f04df92ca6b94e9e830fca420c3e3b86 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:46.963790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:46.965327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:46.980106 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78eecf-d764-4b20-b819-fb0d47548f51 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.039635 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.040348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.040548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.040815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] PATH_INFO: `/v3/projects/cf3604667660441d9c897861368af231` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.041907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3604667660441d9c897861368af231)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.043788 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.089027 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3604667660441d9c897861368af231', 'request_id': 'req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:47.096654 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3604667660441d9c897861368af231', 'request_id': 'req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:47.102060 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3604667660441d9c897861368af231', 'request_id': 'req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:47.114067 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] The token cache is being invalidate because project cf3604667660441d9c897861368af231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:47.114352 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:47.114986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8551c19a-12e1-43a3-bf6c-baab5bcf7da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:47.116523 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1427/2841] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:46 2022] DELETE /identity/v3/projects/cf3604667660441d9c897861368af231 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:47.121612 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.122071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.122172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.141790 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:47.142988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:47.151303 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:47.202630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1415/2842] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:47.210495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.210775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.211041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.230727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:47.231902 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:47.240779 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1428/2843] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:47.245091 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.254864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf61821-e2fd-4f7c-a65e-a7847171b6ed None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.259463 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.260093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.260374 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.260645 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.261281 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:47.261581 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.263160 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.274964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1416/2844] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:39:47.278922 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.293806 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f26c5-cbab-4cd6-9085-9c4f008c4661 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.298708 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.299550 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.299828 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.300127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.300751 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.302685 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.334627 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1429/2845] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:47.339031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.349418 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e371-31be-4059-acd3-1368b7ce3c3b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.405252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.405849 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.406125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.406391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.407008 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.408966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.429108 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1417/2846] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:47.433428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.443323 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6053bd-738a-4f77-abdc-81c3c5b27792 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.447833 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.448449 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.448723 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.448990 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.449620 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.451175 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.461629 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1430/2847] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:47.465391 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.475855 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4eab7-c98c-4bd7-9b40-e44f015fef8e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.480491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b271-cc9b-486e-b44d-102140c3703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.481078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b271-cc9b-486e-b44d-102140c3703f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.481359 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b271-cc9b-486e-b44d-102140c3703f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.481635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b271-cc9b-486e-b44d-102140c3703f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.482298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9b271-cc9b-486e-b44d-102140c3703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.483955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9b271-cc9b-486e-b44d-102140c3703f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.494611 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1418/2848] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:47.498875 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.508607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af5794-ee68-46dc-a0a7-a3f1fea75708 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.513113 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.513744 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.514526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.514795 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] PATH_INFO: `/v3/projects/04f0bdb6330340689525da1fbed0070b/users/a198acce72c14a7c9328c3de67a20b05/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.529040 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f0bdb6330340689525da1fbed0070b, user_id=a198acce72c14a7c9328c3de67a20b05, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.532279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.535245 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:47.546873 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1431/2849] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:47 2022] PUT /identity/v3/projects/04f0bdb6330340689525da1fbed0070b/users/a198acce72c14a7c9328c3de67a20b05/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:47.558442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.558727 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.559002 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.587877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] MFA Rules not processed for user `a198acce72c14a7c9328c3de67a20b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:47.589227 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:47.659249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1419/2850] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:47.663727 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.724609 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1f0f-d3c0-442b-ba82-53798d57cd18 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.729216 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.729818 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.730097 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.730374 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.731001 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.732924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.760085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1432/2851] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:47.764631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.775149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71681f51-8530-4d41-a59e-466a216a4e2f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.779698 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:47.832007 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.832956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.833235 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.833510 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.834140 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.836079 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.857259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1420/2852] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:47 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:47.861217 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.871767 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111825f-36ed-442f-8dee-e6cf95b02557 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.876868 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.877460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.877737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.878006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.878642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.880279 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.891224 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1433/2853] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:47.895137 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.905423 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db39a6-9844-4b86-890c-f0bd02629626 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:47.909904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:47.910536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:47.910813 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:47.911081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] PATH_INFO: `/v3/projects/64d97e6e09644a098397a670b103e430/users/f4c3c21721554f619a6d22f9a93bc9c4/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:47.925930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d97e6e09644a098397a670b103e430, user_id=f4c3c21721554f619a6d22f9a93bc9c4, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:47.929029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:47.941399 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1421/2854] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:47 2022] PUT /identity/v3/projects/64d97e6e09644a098397a670b103e430/users/f4c3c21721554f619a6d22f9a93bc9c4/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:47.946899 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:47.957192 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298528f-f1ab-4bb4-865e-43e0b8b81de0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:48.014578 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b474b73-d6c2-46c6-a2bf-8167eb479292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:48.015181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b474b73-d6c2-46c6-a2bf-8167eb479292 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:48.015462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b474b73-d6c2-46c6-a2bf-8167eb479292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:48.015737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b474b73-d6c2-46c6-a2bf-8167eb479292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:48.016415 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b474b73-d6c2-46c6-a2bf-8167eb479292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:48.018000 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b474b73-d6c2-46c6-a2bf-8167eb479292 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:48.027829 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1434/2855] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:48.032837 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:48.043143 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaf8ca-7644-4411-99e9-c9a4801790d5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:48.047826 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:48.048501 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:48.048784 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:48.049060 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] PATH_INFO: `/v3/projects/64d97e6e09644a098397a670b103e430/users/f4c3c21721554f619a6d22f9a93bc9c4/roles/972430f30d6d40b1b22793c8952f489e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:48.050970 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d97e6e09644a098397a670b103e430, user_id=f4c3c21721554f619a6d22f9a93bc9c4, role_id=972430f30d6d40b1b22793c8952f489e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:48.053629 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:48.063905 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1422/2856] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:48 2022] PUT /identity/v3/projects/64d97e6e09644a098397a670b103e430/users/f4c3c21721554f619a6d22f9a93bc9c4/roles/972430f30d6d40b1b22793c8952f489e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:48.073793 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:48.074276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:48.074388 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:48.102689 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] MFA Rules not processed for user `f4c3c21721554f619a6d22f9a93bc9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:48.103889 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:48.155771 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:48.178117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1435/2857] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:48.189338 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:48.191062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:48.251051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c527c38-7131-4ef7-bb01-998de8e4bec7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:48.254639 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d475a-e4d5-4e39-866e-62bb64b3e794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:48.255252 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d475a-e4d5-4e39-866e-62bb64b3e794 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:48.255509 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d475a-e4d5-4e39-866e-62bb64b3e794 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:48.255778 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d475a-e4d5-4e39-866e-62bb64b3e794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:48.265125 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d475a-e4d5-4e39-866e-62bb64b3e794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:48.266544 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d475a-e4d5-4e39-866e-62bb64b3e794 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:48.275774 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1423/2858] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:49.593408 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:49.653458 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7144a04-3657-4eac-ad3e-801fd0690de3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:49.658496 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:49.659109 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:49.659384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:49.659652 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] PATH_INFO: `/v3/users/a198acce72c14a7c9328c3de67a20b05` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:49.660784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a198acce72c14a7c9328c3de67a20b05)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:49.662667 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:49.706307 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a198acce72c14a7c9328c3de67a20b05'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:49.713495 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a198acce72c14a7c9328c3de67a20b05'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:49.714120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a198acce72c14a7c9328c3de67a20b05'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:49.721544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a198acce72c14a7c9328c3de67a20b05'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:49.733059 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a198acce72c14a7c9328c3de67a20b05'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:49.738725 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1436/2859] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:49 2022] DELETE /identity/v3/users/a198acce72c14a7c9328c3de67a20b05 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:49.743306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031255-cac3-46da-b594-c1425ca087cf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:49.743801 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031255-cac3-46da-b594-c1425ca087cf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:49.743900 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18031255-cac3-46da-b594-c1425ca087cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:49.763273 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-18031255-cac3-46da-b594-c1425ca087cf None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:49.765000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-18031255-cac3-46da-b594-c1425ca087cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:49.823172 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1424/2860] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:49.833521 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:49.834940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:49.891892 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aae73b-55bd-41fa-a987-4dcc8f0793e2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:49.895539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:49.896181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:49.896463 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:49.896736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:49.906333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:49.907749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:49.917165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1437/2861] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:50.179505 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031255-cac3-46da-b594-c1425ca087cf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:50.180959 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-18031255-cac3-46da-b594-c1425ca087cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:50.193231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:50.197551 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18031255-cac3-46da-b594-c1425ca087cf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:50.212871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:50.213563 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:50.213846 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:50.214121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] PATH_INFO: `/v3/projects/04f0bdb6330340689525da1fbed0070b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:50.215315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f0bdb6330340689525da1fbed0070b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:50.217322 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:50.262438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f0bdb6330340689525da1fbed0070b', 'request_id': 'req-88c36fa9-0759-4b56-b2cf-dae595016825'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.270186 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f0bdb6330340689525da1fbed0070b', 'request_id': 'req-88c36fa9-0759-4b56-b2cf-dae595016825'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.275613 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f0bdb6330340689525da1fbed0070b', 'request_id': 'req-88c36fa9-0759-4b56-b2cf-dae595016825'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.286230 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] The token cache is being invalidate because project 04f0bdb6330340689525da1fbed0070b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:50.286512 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.287135 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.288603 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1425/2862] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:50 2022] DELETE /identity/v3/projects/04f0bdb6330340689525da1fbed0070b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:50.292650 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:50.302656 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f16cc8-846f-4522-84e4-7066c7bb045b service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:50.311116 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:50.359569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:50.360214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:50.360490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:50.360758 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] PATH_INFO: `/v3/users/f4c3c21721554f619a6d22f9a93bc9c4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:50.361848 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c3c21721554f619a6d22f9a93bc9c4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:50.363736 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:50.408502 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c3c21721554f619a6d22f9a93bc9c4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.415643 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c3c21721554f619a6d22f9a93bc9c4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.416271 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c3c21721554f619a6d22f9a93bc9c4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.423525 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c3c21721554f619a6d22f9a93bc9c4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.435490 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4ec0dd02-0c55-4c24-a3cc-faca027aa9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c3c21721554f619a6d22f9a93bc9c4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.441805 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1438/2863] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:50 2022] DELETE /identity/v3/users/f4c3c21721554f619a6d22f9a93bc9c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:50.708025 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:50.709502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:50.723753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c36fa9-0759-4b56-b2cf-dae595016825 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:50.781373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:50.781995 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:50.782270 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:50.782542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] PATH_INFO: `/v3/projects/64d97e6e09644a098397a670b103e430` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:50.783659 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d97e6e09644a098397a670b103e430)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:50.785601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:50.832650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d97e6e09644a098397a670b103e430', 'request_id': 'req-08039e6a-497d-4ebf-a740-a8827257a16e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.839705 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d97e6e09644a098397a670b103e430', 'request_id': 'req-08039e6a-497d-4ebf-a740-a8827257a16e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.846062 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d97e6e09644a098397a670b103e430', 'request_id': 'req-08039e6a-497d-4ebf-a740-a8827257a16e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.859348 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] The token cache is being invalidate because project 64d97e6e09644a098397a670b103e430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:50.859630 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.860285 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-08039e6a-497d-4ebf-a740-a8827257a16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:50.861747 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1426/2864] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:50 2022] DELETE /identity/v3/projects/64d97e6e09644a098397a670b103e430 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:50.866576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:50.867053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:50.867186 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:50.886663 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:50.887854 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:50.946068 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1439/2865] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:50.953797 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:50.954083 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:50.954357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:50.973858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:50.975036 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:50.982845 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1427/2866] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:50.988102 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:50.998227 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda89b1-15f6-43c3-a944-07c2b3d10642 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.002814 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.003403 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.003680 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.003975 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.004621 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:51.004924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.006494 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.018428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1440/2867] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:51.022536 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.032357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e5ef2-9fc0-4a69-b46b-b92ee1af42dc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.037020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.037605 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.037879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.038145 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.038764 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.040749 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.049992 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:51.067635 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1428/2868] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:51 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:51.071668 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.081905 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9f26-1d32-44d1-9d4e-21e5077c889f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.099266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:51.140276 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.141400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.141673 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.141939 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.142569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.144492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.166393 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1441/2869] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:51 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:51.170688 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.180791 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e637be-58d6-4d0b-8e87-b7e51495698b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.185357 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.185955 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.186231 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.186503 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.187139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.188757 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.198606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1429/2870] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:51.202676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.213277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfde86-56d0-4b6f-b14e-1950c3ae30bb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.218140 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6a84-90ea-439b-b10f-7d48a6e702b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.218740 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6a84-90ea-439b-b10f-7d48a6e702b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.219607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6a84-90ea-439b-b10f-7d48a6e702b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.219883 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6a84-90ea-439b-b10f-7d48a6e702b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.220585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf6a84-90ea-439b-b10f-7d48a6e702b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.222194 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf6a84-90ea-439b-b10f-7d48a6e702b9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.232798 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1442/2871] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:51.236780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.246874 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1ef7-a09c-4120-8161-33e95b69c654 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.251719 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.252403 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.252679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.252949 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] PATH_INFO: `/v3/projects/8c86580b1dad422db74e374dd2981d1f/users/f753c29881db495f934b021abdf94359/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.267679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c86580b1dad422db74e374dd2981d1f, user_id=f753c29881db495f934b021abdf94359, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.270324 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.283631 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1430/2872] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:51 2022] PUT /identity/v3/projects/8c86580b1dad422db74e374dd2981d1f/users/f753c29881db495f934b021abdf94359/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:51.294877 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508df026-8078-4dfc-9293-034db4d60aed None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.295158 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508df026-8078-4dfc-9293-034db4d60aed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.295429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508df026-8078-4dfc-9293-034db4d60aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.323127 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-508df026-8078-4dfc-9293-034db4d60aed None None] MFA Rules not processed for user `f753c29881db495f934b021abdf94359`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:51.324359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-508df026-8078-4dfc-9293-034db4d60aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:51.386441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1443/2873] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:51.397491 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.399182 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:51.454373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dcf8d-a1fc-45c9-b834-703693788722 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.457994 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3c8c2-7cc6-4633-a103-7193f3b556f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.458589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3c8c2-7cc6-4633-a103-7193f3b556f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.458867 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3c8c2-7cc6-4633-a103-7193f3b556f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.459139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3c8c2-7cc6-4633-a103-7193f3b556f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.467195 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3c8c2-7cc6-4633-a103-7193f3b556f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.468649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3c8c2-7cc6-4633-a103-7193f3b556f7 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.477891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1431/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:51.496819 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508df026-8078-4dfc-9293-034db4d60aed None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.561784 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508df026-8078-4dfc-9293-034db4d60aed None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.566298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.566941 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.567197 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.567467 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] PATH_INFO: `/v3/users/f753c29881db495f934b021abdf94359` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.568595 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f753c29881db495f934b021abdf94359)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.570497 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.602220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:51.616453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f753c29881db495f934b021abdf94359'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:51.623737 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f753c29881db495f934b021abdf94359'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:51.624386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f753c29881db495f934b021abdf94359'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:51.631345 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f753c29881db495f934b021abdf94359'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:51.643220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f753c29881db495f934b021abdf94359'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:51.649042 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1444/2875] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:39:51 2022] DELETE /identity/v3/users/f753c29881db495f934b021abdf94359 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:51.653651 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.653935 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.654206 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.674029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:51.675220 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:51.730916 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1432/2876] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:51.741318 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:51.742711 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:51.799150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe266ee8-f16d-49ba-94bb-7257940b6f68 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:51.802802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdce5f-56d0-4fa0-b6fd-a73891a984a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:51.803400 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdce5f-56d0-4fa0-b6fd-a73891a984a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:51.803676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdce5f-56d0-4fa0-b6fd-a73891a984a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:51.803965 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdce5f-56d0-4fa0-b6fd-a73891a984a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:51.813251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdce5f-56d0-4fa0-b6fd-a73891a984a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:51.814664 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdce5f-56d0-4fa0-b6fd-a73891a984a0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:51.823998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1445/2877] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:39:52.084818 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.086454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:52.099243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e66689-aa2d-4eea-b154-d907a519ea9f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.103873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.104535 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.104811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.105081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] PATH_INFO: `/v3/projects/8c86580b1dad422db74e374dd2981d1f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.106307 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c86580b1dad422db74e374dd2981d1f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.108240 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.154081 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c86580b1dad422db74e374dd2981d1f', 'request_id': 'req-c6f2100c-405c-4698-ace4-d5ca2d1d5461'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:52.156618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:52.161366 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c86580b1dad422db74e374dd2981d1f', 'request_id': 'req-c6f2100c-405c-4698-ace4-d5ca2d1d5461'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:52.168096 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c86580b1dad422db74e374dd2981d1f', 'request_id': 'req-c6f2100c-405c-4698-ace4-d5ca2d1d5461'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:52.178866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] The token cache is being invalidate because project 8c86580b1dad422db74e374dd2981d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:39:52.179149 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:52.179773 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c6f2100c-405c-4698-ace4-d5ca2d1d5461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:39:52.181298 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1433/2878] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:39:52 2022] DELETE /identity/v3/projects/8c86580b1dad422db74e374dd2981d1f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:39:52.186078 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.186538 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.186671 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.206977 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:52.208207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:52.265204 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1446/2879] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:52.273589 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.273877 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.274157 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.294378 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:52.295566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:52.304952 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1434/2880] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:52.309520 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.325912 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d27100-7e40-4f26-a758-903a4d9a02b9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.331206 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.331810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.332122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.332395 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.333041 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:39:52.333340 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.334956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.346462 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1447/2881] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:39:52.350819 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.360457 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eee01-dd2e-4361-bf60-8ba96cf41de3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.365249 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.365850 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.366130 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.366401 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.367094 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.369034 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.396360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1435/2882] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:39:52 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:39:52.400421 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.410150 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc57ba-3794-4f35-8c23-690992f3456a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.442988 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:52.468359 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.469056 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.469277 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.469548 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.470165 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.472103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.493138 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1448/2883] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:39:52 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:39:52.497443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.508201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da83ee-a572-4596-a765-917f1dc88756 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.512713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.513300 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.513575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.513842 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.514471 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.516064 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.526107 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1436/2884] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:52.529807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.539858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df5f7b-360f-4946-881d-b4f98bb3245d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.544705 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3333dfd-b32e-4a14-bb29-435828d2a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.545297 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3333dfd-b32e-4a14-bb29-435828d2a520 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.545576 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3333dfd-b32e-4a14-bb29-435828d2a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.545852 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3333dfd-b32e-4a14-bb29-435828d2a520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.546493 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3333dfd-b32e-4a14-bb29-435828d2a520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.548642 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3333dfd-b32e-4a14-bb29-435828d2a520 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.558539 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1449/2885] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:39:52.562670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.573031 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea2565-5b5d-4797-9012-48b8ad618fdc admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.577694 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.578821 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.579104 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.579373 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] PATH_INFO: `/v3/projects/4dea5917020e461c9de7172d157d4996/users/6f8fa523d83f4f2282810787668eccb3/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.593660 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dea5917020e461c9de7172d157d4996, user_id=6f8fa523d83f4f2282810787668eccb3, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.597059 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.609618 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1437/2886] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:39:52 2022] PUT /identity/v3/projects/4dea5917020e461c9de7172d157d4996/users/6f8fa523d83f4f2282810787668eccb3/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:39:52.619614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.619900 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.620456 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.648702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] MFA Rules not processed for user `6f8fa523d83f4f2282810787668eccb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:39:52.649940 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:52.720220 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1450/2887] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:39:52.731210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:39:52.732932 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:39:52.789360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7cb44-bfd4-44fa-9884-cee1d721779b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:39:52.792948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1515-05ee-4624-9216-a3f0a2040af1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11272670de874c5094fdfb776b4a8b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:39:52.793539 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1515-05ee-4624-9216-a3f0a2040af1 service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:39:52.793812 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1515-05ee-4624-9216-a3f0a2040af1 service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:39:52.794085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1515-05ee-4624-9216-a3f0a2040af1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:39:52.802167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1515-05ee-4624-9216-a3f0a2040af1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:39:52.803574 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1515-05ee-4624-9216-a3f0a2040af1 service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:39:52.812480 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1438/2888] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:39:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:40:02.716333 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:02.808255 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:10.438406 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:10.499073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24f643-475e-4e56-8a4e-eac6d7570c41 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:10.503560 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:10.504210 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:10.504492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:10.504763 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] PATH_INFO: `/v3/users/6f8fa523d83f4f2282810787668eccb3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:10.505906 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8fa523d83f4f2282810787668eccb3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:10.507792 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:10.552386 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8fa523d83f4f2282810787668eccb3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:10.559452 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8fa523d83f4f2282810787668eccb3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:10.560110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8fa523d83f4f2282810787668eccb3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:10.567092 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8fa523d83f4f2282810787668eccb3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:10.578526 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8fa523d83f4f2282810787668eccb3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:10.584749 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1451/2889] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:40:10 2022] DELETE /identity/v3/users/6f8fa523d83f4f2282810787668eccb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:10.589194 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:10.589712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:10.589712 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:10.608679 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:10.609852 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:10.666904 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1439/2890] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:10.676603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:10.678030 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:10.737799 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6d721-a642-4d93-99f1-5f8ae59c4726 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:10.741355 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6a59-3d34-467c-8601-674ee327e4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:10.741963 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6a59-3d34-467c-8601-674ee327e4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:10.742244 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6a59-3d34-467c-8601-674ee327e4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:10.742519 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6a59-3d34-467c-8601-674ee327e4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:10.751692 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6a59-3d34-467c-8601-674ee327e4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:10.753182 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6a59-3d34-467c-8601-674ee327e4f6 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:10.762699 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1452/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:40:11.034722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.036210 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:11.048075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef72ce1-7e87-471f-a65f-c8169fcc94be None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.053578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.054441 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.054537 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.054759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] PATH_INFO: `/v3/projects/4dea5917020e461c9de7172d157d4996` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.056410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dea5917020e461c9de7172d157d4996)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.057976 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.104410 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dea5917020e461c9de7172d157d4996', 'request_id': 'req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:11.111332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dea5917020e461c9de7172d157d4996', 'request_id': 'req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:11.117290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dea5917020e461c9de7172d157d4996', 'request_id': 'req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:11.128864 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] The token cache is being invalidate because project 4dea5917020e461c9de7172d157d4996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:40:11.129147 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:11.129809 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2f67083a-5ef4-4c5d-b1ca-635a75c2bd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:11.131306 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1440/2892] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:40:11 2022] DELETE /identity/v3/projects/4dea5917020e461c9de7172d157d4996 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:11.136232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.136546 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.136822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.158023 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:11.159214 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:11.176633 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:11.223290 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1453/2893] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:11.231139 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.231429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.231706 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.251807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:11.253649 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:11.261464 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1441/2894] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:11.265557 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.274993 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9e0d1-1eed-4483-8628-71d647bcc2ef None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.279483 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.280053 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.280332 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.280601 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.281238 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:40:11.281537 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.283101 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.296120 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1454/2895] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:40:11.301075 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.313262 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44585c-03b7-430b-96c9-1b4962014140 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.318711 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.319316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.319594 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.319866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.320543 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.322438 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.350921 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1442/2896] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:40:11 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:40:11.354964 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.365346 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c73272-7d16-45b1-9d1b-449e6e4b21e7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.419867 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.420492 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.420772 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.421044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.421661 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.423566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.445089 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1455/2897] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:40:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:40:11.449264 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.459609 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596b448-7ad0-4de7-8ab1-6c5ad6fe491d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.464208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.464802 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.465085 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.465356 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.465988 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.467561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.477522 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1443/2898] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:40:11.481384 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.491669 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde70388-1e30-4306-8788-cf9c47a1d2f9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.496566 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c64278-0c1e-42aa-b3ed-e0397fd3470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.497154 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64278-0c1e-42aa-b3ed-e0397fd3470b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.497433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64278-0c1e-42aa-b3ed-e0397fd3470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.497702 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c64278-0c1e-42aa-b3ed-e0397fd3470b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.498337 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c64278-0c1e-42aa-b3ed-e0397fd3470b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.499926 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c64278-0c1e-42aa-b3ed-e0397fd3470b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.511057 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1456/2899] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:40:11.515161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.526068 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ac2b2-6937-43ca-9a00-6d2856febf98 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.531202 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.531873 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.532243 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.532578 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] PATH_INFO: `/v3/projects/7abdf40bb55c4ce795adbcde88e4db12/users/6f0cfebf9a0e47a6a941a3c40fc3246e/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.547701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abdf40bb55c4ce795adbcde88e4db12, user_id=6f0cfebf9a0e47a6a941a3c40fc3246e, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.551208 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.563811 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1444/2900] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:40:11 2022] PUT /identity/v3/projects/7abdf40bb55c4ce795adbcde88e4db12/users/6f0cfebf9a0e47a6a941a3c40fc3246e/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:11.574255 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.574569 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.574847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.602364 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] MFA Rules not processed for user `6f0cfebf9a0e47a6a941a3c40fc3246e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:11.603802 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:11.669544 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1457/2901] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:11.681412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:11.683148 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:11.704316 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:11.739851 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88fd30-f99f-4c84-8d0b-3fe76652d410 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:11.743429 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:11.744049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:11.744328 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:11.744595 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:11.752911 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:11.754318 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:11.762872 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1445/2902] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:40:21.666529 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:21.759078 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=17 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:23.782081 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:23.783427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:23.839181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df121-1dd0-41b9-b71a-f8cd1bb49b3c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:23.842716 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:23.843312 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:23.843588 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:23.843856 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:23.845577 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:23.854917 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:23.856371 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a2d9a-1dc8-418a-9d7a-6f330c951ca3 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:23.864732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1458/2903] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:40:24.177000 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:24.247039 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbab7a6-f1d5-413a-aa9e-da706e865c1f service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:24.251507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:24.252161 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:24.252436 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:24.252704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] PATH_INFO: `/v3/users/6f0cfebf9a0e47a6a941a3c40fc3246e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:24.253814 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0cfebf9a0e47a6a941a3c40fc3246e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:24.255769 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:24.307337 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0cfebf9a0e47a6a941a3c40fc3246e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.316709 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0cfebf9a0e47a6a941a3c40fc3246e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.318167 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0cfebf9a0e47a6a941a3c40fc3246e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.325866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0cfebf9a0e47a6a941a3c40fc3246e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.339286 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0cfebf9a0e47a6a941a3c40fc3246e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.345380 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1446/2904] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:40:24 2022] DELETE /identity/v3/users/6f0cfebf9a0e47a6a941a3c40fc3246e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:24.349932 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:24.350221 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:24.350501 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:24.369603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:24.371103 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:24.431251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1459/2905] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:40:24.441023 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:24.442999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:24.500692 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6a90d-83e7-4035-8b55-4c759443b673 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:24.504388 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ac9ce-29e4-4a36-af02-a168353fc314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:24.505507 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ac9ce-29e4-4a36-af02-a168353fc314 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:24.505781 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ac9ce-29e4-4a36-af02-a168353fc314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:24.506049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ac9ce-29e4-4a36-af02-a168353fc314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:24.514999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ac9ce-29e4-4a36-af02-a168353fc314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:24.516456 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ac9ce-29e4-4a36-af02-a168353fc314 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:24.526680 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1447/2906] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:40:24.812286 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:24.813807 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:24.826237 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107722da-2927-4e58-84d3-4bacb603ca1f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:24.830904 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:24.831603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:24.831969 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:24.832251 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] PATH_INFO: `/v3/projects/7abdf40bb55c4ce795adbcde88e4db12` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:24.833429 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abdf40bb55c4ce795adbcde88e4db12)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:24.835325 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:24.884518 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abdf40bb55c4ce795adbcde88e4db12', 'request_id': 'req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.891876 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abdf40bb55c4ce795adbcde88e4db12', 'request_id': 'req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.897662 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abdf40bb55c4ce795adbcde88e4db12', 'request_id': 'req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.909020 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] The token cache is being invalidate because project 7abdf40bb55c4ce795adbcde88e4db12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:40:24.909310 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.909953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f597b8f2-91ea-4fa8-879b-9c2a2ed4a8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:24.911459 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1460/2907] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:40:24 2022] DELETE /identity/v3/projects/7abdf40bb55c4ce795adbcde88e4db12 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:24.916290 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:24.916597 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:24.916871 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:24.936753 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:24.938022 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:24.955204 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:25.000862 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1448/2908] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:25.009718 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.010002 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.010273 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.029832 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:25.031021 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:25.040907 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1461/2909] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:25.045332 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.055608 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4522-a585-4a74-a7c3-d8fd1d88b244 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.060292 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.060881 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.061162 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.061431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.062072 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:40:25.062375 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.064014 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.075810 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1449/2910] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 12:40:25.080231 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.089570 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24bfb-49ef-4fbc-8349-823bce08b482 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.094361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.094986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.095266 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.095541 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.096235 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.098126 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.119686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:25.128309 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1462/2911] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:40:25 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:40:25.132408 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.142325 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af541-ff9e-489a-94c9-6d2b2c26edc7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.198360 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.199029 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.199606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.199606 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.200201 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.202155 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.224759 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1450/2912] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:40:25 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 12:40:25.228821 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.239822 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e6d69-4e5b-4a24-bdb0-2e8c7cb02e66 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.244085 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.244677 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.244959 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.245229 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.246114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.247686 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.257599 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1463/2913] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:40:25.261223 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.271074 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139362c-4e62-44c9-84bc-c9fbb7b0b6fb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.275780 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c28b7-5b65-4133-bfdb-0b6fb90b1d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.276404 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c28b7-5b65-4133-bfdb-0b6fb90b1d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.276681 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c28b7-5b65-4133-bfdb-0b6fb90b1d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.276951 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c28b7-5b65-4133-bfdb-0b6fb90b1d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.277575 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c28b7-5b65-4133-bfdb-0b6fb90b1d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.279133 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c28b7-5b65-4133-bfdb-0b6fb90b1d81 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.290101 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1451/2914] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:40:25.293921 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.304144 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd85127-039a-41d0-94b8-9eef4fd609d3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.308701 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.309328 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.309604 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.309874 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] PATH_INFO: `/v3/projects/aac08503cda0412c85dfddd26dba5035/users/753e0bc3bbfd42969f0ead46ac22be4e/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.324857 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac08503cda0412c85dfddd26dba5035, user_id=753e0bc3bbfd42969f0ead46ac22be4e, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.327453 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.340487 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1464/2915] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:40:25 2022] PUT /identity/v3/projects/aac08503cda0412c85dfddd26dba5035/users/753e0bc3bbfd42969f0ead46ac22be4e/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 12:40:25.351215 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.351528 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.351803 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.380479 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] MFA Rules not processed for user `753e0bc3bbfd42969f0ead46ac22be4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:25.381697 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:25.444966 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1452/2916] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:25.456339 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:25.458084 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:25.514880 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d092d5-0779-4a16-8612-7c65b6171524 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:25.518554 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfc729-c5f9-4384-a016-63091d447052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:25.519160 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfc729-c5f9-4384-a016-63091d447052 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:25.519438 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfc729-c5f9-4384-a016-63091d447052 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:25.519707 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfc729-c5f9-4384-a016-63091d447052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:25.527890 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfc729-c5f9-4384-a016-63091d447052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:25.529331 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfc729-c5f9-4384-a016-63091d447052 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:25.538071 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1465/2917] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:40:35.441477 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:35.534029 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:49.475482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:49.477602 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:49.575205 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff64a1-c27f-4976-8c3a-82f81fb376e2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:49.580936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd671292a536e4a61931f1127f63c2883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:49.581668 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:49.581999 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:49.582341 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:49.584524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:49.597964 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:49.599677 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:49.613071 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1453/2918] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:40:57.159122 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:57.159607 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:57.159719 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:57.216153 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] MFA Rules not processed for user `57e9b176a3c148f79b4a406b74631713`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:57.217361 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:57.279441 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1466/2919] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 22 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:57.324451 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:57.325883 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:57.413669 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd95085-ed15-4a4f-83a3-67e5f0baa7c8 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:57.418722 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f523c6-6a08-4e40-9783-68782665c7f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1605f3029484ea2a5e98a1b10caf075', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:57.419315 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f523c6-6a08-4e40-9783-68782665c7f6 service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:57.419592 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f523c6-6a08-4e40-9783-68782665c7f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:57.419948 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f523c6-6a08-4e40-9783-68782665c7f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:57.427870 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f523c6-6a08-4e40-9783-68782665c7f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:57.429465 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f523c6-6a08-4e40-9783-68782665c7f6 service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:57.437627 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1454/2920] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 22 12:40:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 12:40:58.555189 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:58.619752 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbf8b8-2a6b-41ce-8e60-433af89b0185 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:58.624555 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:58.625219 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:58.625503 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:58.625773 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] PATH_INFO: `/v3/users/753e0bc3bbfd42969f0ead46ac22be4e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:58.626986 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753e0bc3bbfd42969f0ead46ac22be4e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:58.629953 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:58.691820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753e0bc3bbfd42969f0ead46ac22be4e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:58.703302 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753e0bc3bbfd42969f0ead46ac22be4e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:58.703944 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753e0bc3bbfd42969f0ead46ac22be4e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:58.714174 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753e0bc3bbfd42969f0ead46ac22be4e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:58.723177 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:58.729259 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753e0bc3bbfd42969f0ead46ac22be4e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:58.739267 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1467/2921] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:40:58 2022] DELETE /identity/v3/users/753e0bc3bbfd42969f0ead46ac22be4e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:58.740956 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:58.741442 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:58.741532 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:58.763225 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:58.764486 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:58.825588 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:58.840040 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1455/2922] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:58.849254 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:58.850670 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:58.909298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253bcf-ed9d-4d4c-8ed9-7f33a16f9c91 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:58.913594 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946403ee-b70c-4e5d-9cb0-8aa580c96401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:58.914232 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946403ee-b70c-4e5d-9cb0-8aa580c96401 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:58.914509 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946403ee-b70c-4e5d-9cb0-8aa580c96401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:58.914775 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946403ee-b70c-4e5d-9cb0-8aa580c96401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:58.924167 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946403ee-b70c-4e5d-9cb0-8aa580c96401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:58.925618 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946403ee-b70c-4e5d-9cb0-8aa580c96401 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:58.935317 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1468/2923] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:40:59.215758 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.217297 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:59.244490 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd81b-a402-4a17-9116-4a0587f417fe None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.250553 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.251350 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.251701 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.252412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] PATH_INFO: `/v3/projects/aac08503cda0412c85dfddd26dba5035` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.253751 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac08503cda0412c85dfddd26dba5035)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.256529 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.310636 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac08503cda0412c85dfddd26dba5035', 'request_id': 'req-6ed6d741-c9b3-4b01-9e41-f73b60930981'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:59.322311 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac08503cda0412c85dfddd26dba5035', 'request_id': 'req-6ed6d741-c9b3-4b01-9e41-f73b60930981'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:59.330061 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac08503cda0412c85dfddd26dba5035', 'request_id': 'req-6ed6d741-c9b3-4b01-9e41-f73b60930981'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:59.341866 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] The token cache is being invalidate because project aac08503cda0412c85dfddd26dba5035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:40:59.342151 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:59.342807 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6ed6d741-c9b3-4b01-9e41-f73b60930981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:40:59.344610 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1456/2924] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:40:59 2022] DELETE /identity/v3/projects/aac08503cda0412c85dfddd26dba5035 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:59.349243 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.349528 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.349810 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.373765 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:59.375230 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:59.444728 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1469/2925] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:59.511283 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.511650 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.511836 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.533902 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:59.535171 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:40:59.556121 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1457/2926] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:40:59.560774 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.575823 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bac3-84e8-4b6b-85f6-f596884f8795 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.581298 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.582050 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.582428 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.583073 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.584258 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 12:40:59.584713 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.586658 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.607998 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1470/2927] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 22 12:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 12:40:59.612015 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.624454 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa748-2496-4ffa-b13a-821823b1402f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.629967 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.630754 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.631219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.631713 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.632534 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.634936 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.670572 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1458/2928] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 22 12:40:59 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:40:59.674999 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.690305 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08133f6a-17b4-471a-a8b3-de081d6c91da admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.764063 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.764696 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.764980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.765327 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.765942 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.767916 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.794531 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1471/2929] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 22 12:40:59 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 12:40:59.795616 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.806173 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707d8e-8fa6-4b8d-8d8b-a39d72a061ca admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.812257 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.812920 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.813203 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.813542 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.814185 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.815828 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.826524 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1459/2930] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 12:40:59.830759 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.841432 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdab4a-34db-4199-a633-eb35efbb9060 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.846176 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9baed-7a3f-40a2-8b8f-b33a2d5ce469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.846834 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9baed-7a3f-40a2-8b8f-b33a2d5ce469 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.847110 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9baed-7a3f-40a2-8b8f-b33a2d5ce469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.847376 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9baed-7a3f-40a2-8b8f-b33a2d5ce469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.848044 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9baed-7a3f-40a2-8b8f-b33a2d5ce469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.849614 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9baed-7a3f-40a2-8b8f-b33a2d5ce469 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.855464 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:59.861731 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1472/2931] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 22 12:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 12:40:59.866049 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:40:59.876323 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017dc38-4669-4b2a-8b30-1c47e0361772 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:40:59.880897 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:40:59.881561 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.881817 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.882088 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] PATH_INFO: `/v3/projects/32174b2f83c042ce88cfd068d63a6cd4/users/bc4caf18c1b2486289042290071a1c33/roles/1c178a8418b14b00ae66f630cb16a8a3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.897136 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32174b2f83c042ce88cfd068d63a6cd4, user_id=bc4caf18c1b2486289042290071a1c33, role_id=1c178a8418b14b00ae66f630cb16a8a3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:40:59.900385 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:40:59.916468 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1460/2932] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 22 12:40:59 2022] PUT /identity/v3/projects/32174b2f83c042ce88cfd068d63a6cd4/users/bc4caf18c1b2486289042290071a1c33/roles/1c178a8418b14b00ae66f630cb16a8a3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:40:59.926924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:40:59.927209 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:40:59.927486 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:40:59.956895 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] MFA Rules not processed for user `bc4caf18c1b2486289042290071a1c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:40:59.958152 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:00.035651 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1473/2933] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 12:41:00.043891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:00.045666 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:00.115567 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b959-e5fb-4cb9-b502-1a324bcb60d6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:00.120063 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc7ee82e55b8416dbf41dd368cc435d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:00.120601 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:00.120891 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:00.122331 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:00.132336 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:00.133788 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:00.142853 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1461/2934] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:41:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 12:41:04.051348 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:04.053465 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:04.120809 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf37e17-7828-4b9b-83ad-c728e85ba8f4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:04.125506 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:04.126240 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:04.126558 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:04.126831 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] PATH_INFO: `/v3/users/f2d08596cf394dd9adab9164ca469ba9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:04.128006 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d08596cf394dd9adab9164ca469ba9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:04.129924 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:04.185272 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d08596cf394dd9adab9164ca469ba9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.196129 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d08596cf394dd9adab9164ca469ba9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.196923 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d08596cf394dd9adab9164ca469ba9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.208252 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d08596cf394dd9adab9164ca469ba9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.221847 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d08596cf394dd9adab9164ca469ba9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.228334 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1474/2935] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:41:04 2022] DELETE /identity/v3/users/f2d08596cf394dd9adab9164ca469ba9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:41:04.405858 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:04.417093 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f840e0a-d70f-46bb-8636-3cbc4282505b service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:04.436670 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:41:04.490520 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:04.491191 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:04.491431 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:04.491728 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] PATH_INFO: `/v3/projects/8f2b4ed5a83a430490c72866006b5f57` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:04.493398 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2b4ed5a83a430490c72866006b5f57)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:04.495962 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:04.545092 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2b4ed5a83a430490c72866006b5f57', 'request_id': 'req-8f23ddd5-0303-4273-8fae-67254d7c4f14'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.555494 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2b4ed5a83a430490c72866006b5f57', 'request_id': 'req-8f23ddd5-0303-4273-8fae-67254d7c4f14'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.563880 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2b4ed5a83a430490c72866006b5f57', 'request_id': 'req-8f23ddd5-0303-4273-8fae-67254d7c4f14'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.577704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] The token cache is being invalidate because project 8f2b4ed5a83a430490c72866006b5f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:41:04.578219 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.579048 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.580566 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1462/2936] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:41:04 2022] DELETE /identity/v3/projects/8f2b4ed5a83a430490c72866006b5f57 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:41:04.584972 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:04.586394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:04.601603 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102656da-84de-47b4-8970-9e102d0756c2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:04.611596 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:41:04.669480 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:04.670117 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:04.670399 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:04.670676 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] PATH_INFO: `/v3/users/4eab86bafa2a403baf68c7c7daa9290f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:04.671820 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eab86bafa2a403baf68c7c7daa9290f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:04.674303 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:04.724815 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eab86bafa2a403baf68c7c7daa9290f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.733288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eab86bafa2a403baf68c7c7daa9290f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.734114 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eab86bafa2a403baf68c7c7daa9290f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.741694 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eab86bafa2a403baf68c7c7daa9290f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.754974 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eab86bafa2a403baf68c7c7daa9290f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:04.761133 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1475/2937] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:41:04 2022] DELETE /identity/v3/users/4eab86bafa2a403baf68c7c7daa9290f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:41:04.941584 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:04.943020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:04.968443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23ddd5-0303-4273-8fae-67254d7c4f14 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:05.030879 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:05.031617 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:05.032102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:05.032412 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] PATH_INFO: `/v3/projects/d81d987fa74346b79704a0b67620dacf` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:05.033869 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81d987fa74346b79704a0b67620dacf)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:05.036102 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:05.089560 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81d987fa74346b79704a0b67620dacf', 'request_id': 'req-186d779c-62ca-4d4a-b474-9b61656ad52a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:05.091294 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:41:05.099470 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81d987fa74346b79704a0b67620dacf', 'request_id': 'req-186d779c-62ca-4d4a-b474-9b61656ad52a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:05.106067 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81d987fa74346b79704a0b67620dacf', 'request_id': 'req-186d779c-62ca-4d4a-b474-9b61656ad52a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:05.120232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] The token cache is being invalidate because project d81d987fa74346b79704a0b67620dacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:41:05.120232 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:05.120704 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-186d779c-62ca-4d4a-b474-9b61656ad52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:05.122443 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1463/2938] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:41:04 2022] DELETE /identity/v3/projects/d81d987fa74346b79704a0b67620dacf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:41:10.389789 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:10.391207 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:10.404270 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c998c7-d8bb-4801-b8f9-1bc66cf50324 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:10.458644 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:10.459181 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:10.459460 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:10.459732 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] PATH_INFO: `/v3/users/bc4caf18c1b2486289042290071a1c33` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:10.460871 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4caf18c1b2486289042290071a1c33)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:10.463394 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:10.498369 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:41:10.512761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4caf18c1b2486289042290071a1c33'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:10.519790 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4caf18c1b2486289042290071a1c33'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:10.520427 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4caf18c1b2486289042290071a1c33'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:10.527956 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4caf18c1b2486289042290071a1c33'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:10.539761 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4caf18c1b2486289042290071a1c33'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:10.546433 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1476/2939] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 22 12:41:10 2022] DELETE /identity/v3/users/bc4caf18c1b2486289042290071a1c33 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:41:10.551259 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:10.551760 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:10.551876 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:10.571051 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] MFA Rules not processed for user `fd86245075d845f9b1e45490eee3a3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 12:41:10.572327 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:10.630626 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1464/2940] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 22 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 12:41:10.640858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:10.642264 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:10.699065 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf467-0e5d-473d-b075-c48d156670ac admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:10.702688 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f34655a63e6441f995031cdf8770741e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:10.703287 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:10.703565 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:10.703837 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:10.713481 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:10.714825 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:10.724288 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1477/2941] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:41:11.000493 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:41:11.001930 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:41:11.014343 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02009-9864-4a3b-98b1-cb6874b26c0c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:41:11.018942 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd86245075d845f9b1e45490eee3a3a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1d2459aef21456aad8510f367ebb7a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:41:11.019977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:41:11.019977 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:41:11.020335 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] PATH_INFO: `/v3/projects/32174b2f83c042ce88cfd068d63a6cd4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:41:11.021482 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32174b2f83c042ce88cfd068d63a6cd4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:41:11.023371 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:41:11.070221 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32174b2f83c042ce88cfd068d63a6cd4', 'request_id': 'req-61756767-ac35-43f3-8054-b2440d272cd9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:11.077972 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32174b2f83c042ce88cfd068d63a6cd4', 'request_id': 'req-61756767-ac35-43f3-8054-b2440d272cd9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:11.083376 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32174b2f83c042ce88cfd068d63a6cd4', 'request_id': 'req-61756767-ac35-43f3-8054-b2440d272cd9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:11.094116 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] The token cache is being invalidate because project 32174b2f83c042ce88cfd068d63a6cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 12:41:11.094402 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:11.095020 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61756767-ac35-43f3-8054-b2440d272cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 12:41:11.096502 dv-cinder-856463-4-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1465/2942] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 22 12:41:10 2022] DELETE /identity/v3/projects/32174b2f83c042ce88cfd068d63a6cd4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 12:41:20.719952 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:41:21.091174 dv-cinder-856463-4-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=60 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:43:24.383316 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 12:43:24.384824 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:43:24.452293 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb690ca-9a93-4c4c-bd0e-55fbc540913a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 12:43:24.509980 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18dcb13de7d84c88bf32e41e103f7e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ed0b1ca02e24a7f8f5e448387448e25', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 12:43:24.510585 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 12:43:24.510858 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 12:43:24.511130 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 12:43:24.512872 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 12:43:24.523697 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 12:43:24.525301 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbebc7-4e84-4e4e-b193-21b75d5c8e77 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 12:43:24.535012 dv-cinder-856463-4-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1478/2943] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 22 12:43:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 12:43:34.530846 dv-cinder-856463-4-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=58 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}